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Introduction 

In this paper we give formulas for the fundamental classes of Schubert subschemes 
in Lagrangian and orthogonal Grassmannians of maximal rank subbundles as well as 
some globalizations of them. Our motivation to deal with this subject came essentially 
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from 3 examples where such degeneracy loci appear in algebraic geometry: 1° The 
Brill-Noether loci for Prym varieties, as defined by Welters [W], 2° The loci of curves 
with sufficiently many theta characteristics, as considered by Harris [Har], 3° Some 
"higher" Brill-Noether loci in the moduli spaces of higher rank vector bundles over 
curves, considered by Bertram and Feinberg [B-F] and, independently, by Mukai [Mu]. 

The common denominator of these 3 situations is a simple and beautiful construction 
of Mumford [M]. With a vector bundle over a curve equipped with a nondegenerate 
quadratic form with values in the sheaf of 1-differentials, Mumford associates an even 
dimensional vector space endowed with a nondegenerate quadratic form and 2 maximal 
isotropic subspaces such that the space of global sections of the initial bundle is the 
intersection of the two isotropic subspaces. A globalization of this construction allows 
one to present in a similar way the varieties in 1° and 2° above as loci where two isotropic 
rank n subbundles of a certain rank 2n bundle equipped with a quadratic nondegenerate 
form, intersect in dimension exceeding a given number. On the other hand, the locus in 
3° admits locally this kind of presentation using an appropriate symplectic form. 

These varieties are particular cases of Schubert subschemes in Lagrangian and or- 
thogonal Grassmannian bundles and their globalizations. The formulas for such loci are 
the main theme of this paper. More specifically, given a vector bundle V on a vari- 
ety X, endowed with a nondegenerate symplectic or orthogonal form, we pick E and 
Fi C F2 C ... C Fn = F - isotropic subbundles of V {rank E — n, rank F^ — i) and for 
a given sequence 1 ^ ai < ... < ^ n we look at the locus: 

D{a.) ■.= {xeX\ dim{E n F^J^ ^p, p=l, k}. 
We distinguish three cases: 

1. Lagrangian: rank V = 2n, the form is symplectic; 

2. odd orthogonal: rank V = 2n-\-l, the form is orthogonal; 

3. even orthogonal: rank V = 2n, the form is orthogonal. 

(In the latter case the definition of D{a.) must be slightly modified - see Section 9.) 

Let us remark that the loci D{a.) (for the Lagrangian case) admit an important 
specialization to the loci introduced by Ekedahl and Oort in the moduli space of abelian 
varieties with fixed dimension and polarization, in characteristic p (see, e.g. [O], the 
references therein and [E-vG]). This comes from certain filtrations on the de Rham 
cohomology defined with the help of the Frobenius- and " Verschiebung"-maps. The 
formulas of the present paper are well suited to computations of the fundamental classes 
of such loci in the Ghow groups of the moduli spaces - for details see a forthcoming paper 
by T. Ekedahl and G. van der Geer [E-vG]. 

The goal of this paper is to give an algorithm for computing the fundamental classes 
of D{a.) as polynomials in the Ghern classes of E and Fj. Formulas given here can be 
thought of as Lagrangian and orthogonal analogs of the formulas due independently to 
Kcmpf-Laksov [K-L] and Lascoux [LI] (notice, however, that the formulas given in [K-L] 
are proved under a weaker assumption of "expected" dimension). 
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The method for computing the fundamental class of a subscheme of a given (smooth) 
scheme which we use here stems from a paper by the first author [P3, Sect. 5]. It depends 
on a desingularization of the subscheme in question and the knowledge of the class of 
the diagonal of the ambient space. It appears that the diagonals in the fibre products 
of Lagrangian or orthogonal Grassmannian- and fiag bundles are not given as the sub- 
schemes of zeros of sections of bundles over the corresponding products. This makes an 
additional difficulty (e.g. in comparison with [K-L]) which is overcomed here using again 
a result from [P3, Sect. 5] allowing to compute the class od the diagonal with the help of 
an appropriate "orthogonality" property of Gysin maps. 

To establish formulas for the classes of these diagonals, we use essentially two tools. 
The first one is Theorem 6.17 of [P2] interpreting (cohomology dual to) the classes 
of Schubert subvarieties in Lagrangian and orthogonal Grassmannians as Schur's Q- 
and P-polynomials. The importance of these polynomials to algebraic geometry was 
illuminated by the first author in [PI] and then developed in [P2]. In fact in [P2, 
Sect. 6], a variant of these polynomials was used to give a full description of Schubert 
Calculus on Grassmannians of maximal dimensional isotropic subspaces associated with a 
nondegenerate symplectic and orthogonal form. These familes of symmetric polynomials 
are called Q- and P-polynomials in the present paper. Perhaps the "orthogonality" 
proved in Theorem 5.23 is their central property. This is, in fact, the second tool in 
our computation of the classes of the diagonals in isotropic Grassmannian bundles which 
allows us to apply the technique of [P3, Sect. 5]. The results of [P2, Sect. 6], recalled in 
Theorem 2.1 below, are a natural source of the ubiquity of Q- and P-polynomials in 
various formulas of this paper. As a general rule, these are Q-polynomials that appear 
in the Lagrangian case and P-polynomials that appear in the orthogonal cases. 

In general, our approach gives an efficient algorithm for finding formulas for La- 
grangian and orthogonal Schubert subschemes. In several cases, however, we are able 
to give compact expressions. At first, these are the cases of one (i.e. k = 1) and two 
Schubert conditions (the case of one Schubert condition is usually referred to as a special 
Schubert subscheme). The corresponding formulas are given in Section 6 and 7. 

The derivation of those formulas uses a formula for the push-forward of Q-polynomials 
(Theorems 5.10, 5.14, 5.20) from isotropic Grassmannian bundles. For instance, in the 
Lagrangian case, tt : LGnV X with the tautological subbundle P, the element QjR"^ 
has a nonzero image under tt^, only if each number p, 1 ^ p ^ n, appears as a part of / 
with an odd multiplicity nip. If the latter condition holds then 

n 

p=i 

We also give formulas for the push-forward of 5'-polynomials (Theorems 5.13, 5.15, 
5.21) from isotropic Grassmannian bundles. For example, in the Lagrangian case, the 
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element s/i?^ has a nonzero image under tt^ only if the partition / is of the form 1J + 
for some partition J (here, pn = {n,n — 1, If / = 2 J + then 

7r*s/it = Sj V , 

where the right hand side is defined as follows: if sj — P{e.) is a unique presentation of 
sj as a polynomial in the elementary symmetric functions e^, E— a vector bundle, then 
s^j\e) := P with Cj replaced by (-l)*C2i-E', z = 1, 2, . . . . 

Another case (corresponding to the Schubert condition a. = {n — k + 1, ?7,)) that 
leads to compact formulas is the variety of maximal rank isotropic subbundles which 
intersect a fixed maximal rank isotropic subbundle in dimension exceeding a given num- 
ber (Proposition 3.2 and its analogs). Thanks to the Cohen-Macaulayness of Schubert 
subschemes in isotropic Grassmannians proved in [DC-L] , one gets globalizations of those 
formulas (as well as the other ones) to more general loci. For instance, the latter case 
o. = (n — A; + 1, n) globalizes to the Mumford type locus discussed above where two 
maximal rank isotropic subbundles E and F intersect in dimension exceeding k, say.^ 

Our formulas (see Theorems 9.1, 9.5 and 9.6) are quadratic expressions in Q- and 
P-polynomials of the subbundles. More explicitly in the corresponding cases we have 

1. Lagrangian: Y.QiE'^ ' Q(k,k-i,... ,i)-~.iF'^; 

2. odd orthogonal: E^/^"" " P(k,k-i,... ,i)~.iF'' ; 

3. even orthogonal: E PjE"^ ' P{k-i,k-2,... ,i)^iF'^; 

where in 1. and 2. the sum is over all subsequences /in(/c,/c — l,...,l),in3. the sum 
is over all subsequences / in (A; — 1, A; — 2, . . . , 1) and {k,k — 1, . . . , 1) \ / denotes the 
strict partition whose parts complements the ones of / in {k, k — 1, . . . ,1}. 

Formula 3. has been recently used by C. De Concini and the first named author in 
[DC-P] to compute the fundamental classes of the Brill-Noether loci V"^ for the Prym 
varieties (sec [W]), thus solving a problem of Welters, left open since 1985. The formula 
of [DC-P] asserts that if either is empty or of pure codimension r(r-|-l)/2 in the Prym 
variety then its fundamental class in the numerical equivalence ring, or its cohomology 
class is equal to 

2r(r-l)/2 -Q^^. _ ;^),/(2^ _ 1)!) [S]Kr+l)/2^ 
i=l 

where S is the theta divisor on the Prym variety. 
The paper is organized as follows. 



^It is mentioned in [Fl,2] that the problem of finding formulas for the classes in this case was posed 
originally by Professor J. Harris several years ago. 
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Section 1 contains definitions and properties of Schubert varieties in Lagrangian and 
orthogonal Grassmannian bundles. Also, some desingularizations of these varieties, used 
in later sections, are described. 

Section 2 contains some recollections of Schubert calculus for Lagrangian and orthog- 
onal Grassmannians from [P2, Sect. 6] and computation of the classes of the diagonals in 
the Chow rings of Lagrangian and orthogonal Grassmannian bundles. This computation 
relies on the Gysin maps technique from [P3, Sect. 5] and on the orthogonality theorem 
5.23 which is proved independently later. 

Section 3 contains an explicit computation of Gysin maps needed to determine the 
formulas for the fundamental classes of Schubert varieties Q,{n — k + l,... , n) parametriz- 
ing subbundles intersecting an n-subbundle in dimension exceeding k. This is done using 
an elementary Schubert Calculus-type technique based on linear algebra. 

In Section 4 we introduce a family of symmetric polynomials called Q-polynomials 
which is modelled on Schur's Q-polynomials (but is different from the latter family). 
These polynomials are the basic algebraic tools of the present paper. We prove several 
elementary but useful properties of Q-polynomials and give some examples. 

In Section 5 we establish some new algebraic properties of of Q-polynomials and S- 
polynomials; these are either certain determinantal identities like Propositions 5.2 and 
5.11, or the computation of the values of these polynomials under some divided differences 
operators. These algebraic results are then interpreted using Gysin maps for Lagrangian 
and orthogonal Grassmannian bundles. Perhaps the most important result of this section 
is the "orthogonality" Theorem 5.23. This theorem, interpreted geometrically (using a 
result of [P3, Sect. 5]), gives us the classes of the diagonals of Lagrangian and orthogonal 
Grassmannian bundles which are crucial for our computations. 

Sections 6., 7. and 8. have a supplementary character. They contain some examples 
and a certain alternative (to the content of the previous sections) way of computing. 
Section 6 contains formulas for Schubert varieties defined by one Schubert condition in 
Lagrangian and orthogonal cases. Section 7 contains similar computations for two Schu- 
bert conditions in the Lagrangian and odd orthogonal cases. Section 8 contains another 
(purely algebraic) proof, using divided differences, of Proposition 3.1 that describes the 
Gysin maps for some flag bundles. 

In Section 9 we formulate previous results in the general setup of degeneracy loci and 
give some examples. A special emphasis is put on formulas answering J. Harris' problem 
concerning the Mumford-type degeneracy loci described above. 

In Appendix A we collect a number of useful results about Quatcrnionic Grassman- 
nians. We use them to reprove some results proved earlier using different methods and 
to show how some problems concerning Grassmannians of nonmaximal Lagrangian sub- 
spaces can be reduced to those of maximal Lagrangian subspaces; this sort of applications 
we plan to develop elsewhere. 

Finally, in Appendix B, we give an introduction to a theory of symplectic Schubert 
polynomials which has grown up from the present work. This theory (see [L-P-R]) seems 
to be well suited to the needs of algebraic geometry because it generalizes in a natural 
way Q-polynomials which govern the Schubert calculus on Lagrangian Grassmannians. 
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In Sections 2, 3, 5, 6, 7, 8 and 9 we work in the Chow rings; all results therein, 
however, are equally valid in the cohomology rings. 

Some of the results of this paper were announced in [P-RO] . 

The paper is a revised version of the Max-Planck Institut fiir Mathematik Preprint 
MPI / 94 -132. 
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mail announcement. Both the form of the formulas obtained as well as the approach used 
in [Fl,2] are totally different from the content of our work and just a simple comparison of 
the results of [Fl,2] with ours leads to very nontrivial new identities which arc interesting 
in themselves. It would be desirable to develop, in a systematic way, the comparison of 
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formulas given in [Fl,2] from one side with those in the present paper and [P-RO] - from 
the other one. 



Conventions 

Partitions are weakly decreasing sequences of positive integers (as in [Modi] and are 
denoted by capital Roman letters (as in [L-Sl]). We identify partitions with their Ferrers' 
diagrams visualized as in [L-Sl]. The relation "c" for partitions is induced from that 
for diagrams. 

For a given partition I = {ii,i2, . . .) we denote by |/| (the weight of /) the partitioned 
number (i.e. the sum of all parts of /) and by /(/) (the length of /) the number of nonzero 
parts of /. Moreover, /'^ denotes the dual partition of /, i.e. = (ji,j2, • • •) where 
jp = card{h\ih ^ p}, and (i)'' - the partition (i, . . . , i) (fc-times). 

Given sequences I — (i i , ^2 , • • • ) and J = (j i , j2 , • • • ) we denote by / ± J the sequence 
{ii±ji,i2 ±j2,.--)- 

By strict partitions we mean those whose (positive) parts are all different. 

In this paper, we denote by Si{E) the complete symmetric polynomial of degree i with 
variables specialized to the Chern roots of a vector bundle E. 

The reader should be careful with our notion of Q-polynomials here. Namely, since 
we are mainly interested in the polynomials in the Chern classes of vector bundles, we 
introduce Q-polynomials given by the Pfafiian of an antisymmetric matrix whose entries 
are quadratic expressions in the elementary symmetric polynomials rather than in the 
"one row" Schur's Q-polynomials. Therefore these polynomials are different from the 
original Schur's Q-polynomials. Note that nonzero Q-polynomials Qi{xi,... ,Xn) are 
indexed by "usual" partitions / but the parts of these partitions cannot exceed the 
number of variables; on the contrary, nonzero Schur's Q-polynomials Qi{xi, . . . , Xn) are 
indexed by strict partitions / only but the parts of these partitions can be bigger than 
the number of variables. 

Also, the specialization of Qi{xi, . . . , x^) with [xi) equal to the sequence of the Chern 
roots of a rank n vector bundle E, denoted here - accordingly - by QjE, is a different 
cohomology class than the one associated with E in [PI] and [P2, Sect. 3 and 5], and 
denoted by QiE therein. (Notice, however, that the Q-polynomials appeared already in 
an implicit way in [P2, Sect. 6].) The reader should make a proper distinction between 
Schur's Q-polynomials and Q-polynomials that are mainly used in the present paper. 

For a vector bundle V, by GnV we denote the usual Grassmannian bundle parametriz- 
ing rank n subbundles of V. Moreover, F(V) = GiV. We follow mostly [F] for the 
terminology in algebraic geometry. In many situations when the notation starts to be 
too cumbersome, we omit some puUback-indices of the induced vector bundles. 

A good reference for "changes of alphabets" in the A-ring sense is [L-Sl]. 
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1. Schubert subschemes and their desingularizations 

We start with the Lagrangian case. Let K be an arbitrary ground field. 

Assume that y is a rank 2n vector bundle over a smooth scheme X over K equipped 
with a nondcgcncrate symplectic form. Moreover, assume that a flag V. : C V2 C . . . C 
Vn of Lagrangian (i.e. isotropic) subbundles w.r.t. this form is fixed, with rank Vi = i. 
Let TT : LGn{V) — > X denote the Grassmannian bundle parametrizing Lagrangian rank 
n subbundles of V. G = LGn{V) is endowed with the tautological Lagrangian bundle 
R C Vo- Given a sequence a. = (1 ^ ai < . . . < ^ n) we consider in G a closed 
subset: 

0(a.) = 0(a.; V.) = {g e G\ dim{R n ^ i, z = 1, . . . , k}. 

The locus 0(a.), called a Schubert subscheme is endowed with a reduced scheme structure 
induced from the reduced one of the corresponding Schubert subscheme in the Grass- 
mannian GnV - this is discussed in detail , e.g., in [L-Se]. 

The following desingularization of O = 0(a.) should be thought of as a Lagrangian 
analogue of the construction used in [K-L]. Let JF = jF(a ) = J-'{Va^ C . . . C Va^.) be the 
scheme parametrizing flags Ai G A2 G . . . G G A^+i such that rank Ai = i and 
Ai G 14. for i = 1, . . . , k ; rank Aj.^i — n and A^^i is Lagrangian. JF is endowed 
with the tautological flag Di G D2 . . . G G i^fc+i, where rank Di = i, i = 1, . . . , k 
and rank Df~+i = n . We will write D instead of Dfe+i. 

We have a flbre square: 



pi 

G > X 

Let a : ^ G he the map deflned by: {Ai G A2 G . . . G A^+i) Ak+i, in other words 
Q! is a "classifying map" such that a*R = D. It is easily verifled that a maps JF onto 
n and a is an isomorphism over the open subset of fl parametrizing rank n Lagrangian 
subbundles A of V such that rank{A ^\Va^) = i, i = 1, . . . , fc. Moreover, a induces a 
section s of p2- Set Z := s{J^) G Gx^T. Alternatively, we can describe Z as (1 xq!)~^(A) 
where A is the diagonal in G C The map pi restricted to Z is a desingularization 
of O. Therefore [Q] = {pi)^{[Z]). On the other hand, [Z] = (1 x a)*([A]) (see [K- 
L, Lemma 9]). Note that T is obtained as a composition of the following flag- and 
Grassmannian bundles. Let Fl = Fl{a.) — Fl{Va^ G ... G Va^) be the "usual" flag 
bundle parametrizing flags Ai G . . . G Af^ where rank A^ = i and A^ G 14^ , i = 1, . . . , k. 
Let Ci C . . . C Cfc be the tautological flag on FL We will write C instead of Ck- Then 
JF is the Lagrangian Grassmannian bundle LGn-k{C'^ /C) over Fl, where C"*- is the 
subbundle of Vpi consisting of all v that are orthogonal to C w.r.t. the given symplectic 
form. Note that C G C"*- because C is Lagrangian, rank{C^ /C) = 2(n — k) and the 
vector bundle C-^/C is endowed with a nondegenerate symplectic form induced from the 
one on V. Of course the tautological Lagrangian rank n — k subbundle on LGn-k{C^ /C) 
is identifled with D/Cjr. In other words, .F" is a composition of a flag bundle (with the 
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fiber being Fl{K^^ C . . . C K"''')) and a Lagrangian Grassmanian bundle (with the fiber 
being LGn-k{K^^'^~''^). In particular, 

k 

dim Q = dim T = dim Z = ^^(^i — i) + (n — k){n — k + l)/2 + dim X. 

i=l 

The following particular cases will be treated in a detailed way in this paper: a. = 
(n — /c + 1, n — /c + 2, ... , n) (then 0(a.) parametrizes Lagrangian rank n subbundles L of 

V such that rank{LnVn) ^ k ); a. — (n + l — i) , i.e. k — 1 ; and a. — {n + l — i, n+l—j), 
i.e. k = 2. 

Now consider the odd orthogonal case. Let be a ground field of characteristic dif- 
ferent from 2. Assume, that V is a rank 2n + 1 vector bundle over a smooth scheme 
X over K equipped with a nondegenerate orthogonal form. We assume throughout this 
paper that the form restricts to a hyperbolic form on each fiber (i.e. each fiber has 
an n-dimensional isotropic subspace; if K is algebraically closed, this is automatically 
satisfied.) Let OGnV be the Grassmannian bvmdle parametrizing rank n isotropic sub- 
bundles of V . Whenever, in this paper, we speak about OGnV, we assume that there 
exists a rank n isotropic subbundle in V. All definitions, notions and notation concern- 
ing Schubert subschemes and their desingularizations are used mutatis mutandis (just 
instead of "symplectic" use "orthogonal" and instead of "Lagrangian" use "isotropic"). 
The formula for the dimension of 0(a.) in the odd orthogonal case is the same as in 
the Lagrangian case. Of course, J-' is now a composition of the same fiag bundle Fl 
and the odd orthogonal Grassmannian bundle OGn-k{C'^ /C), where C is the rank k 
tautological subbundle on Fl. 

Assume now that F is a rank 2n vector bundle over a smooth connected scheme X 
over a field K of characteristic different from 2 equipped with a nondegenerate orthogonal 
form. We assume throughout this paper that there exists an isotropic rank n subbundle 
of V . The scheme parametrizing isotropic rank n subbundles of V breaks up into two con- 
nected components denoted OG'^V and OG'^V . Let be a rank n isotropic subbundle of 

V fixed once and for all. Then OG'^V (resp. OG'^V) parametrizes rank n isotropic sub- 
bundles E <zV such that dim{Er\Vn)x = n{mod 2) (resp. dim{EnVn)x = n + l{mod 2) 
) for every x e X. Write G' := OG^V and G" := OG'^V. Two isotropic rank n subbun- 
dles are in the same component iff they intersect fiberwise in dimension congruent to n 
modulo 2. 

Let F. : Vi C V2 C . . . C Fn be a fiag of isotropic subbundles of V with rank Vi = i. 
Given a sequence a, = (1 ^ ai < . . . < ak ^ n) such that k = n (mod 2), we consider in 
G' a Schubert subvariety: 

n{a.) = n{a.;V.) = j^f G G'\ dim{R n Kj^ > i, z = 1, . . . , /c} 

{R C Vg' is here the tautological bundle). Similarly, given a sequence a_ — {1 ^ ai < 
. . . < ak ^ n) such that k = n+1 {mod 2), we consider in G" a Schubert subvariety 

n{a.) = n(a ; V.) ^ {g e G"\ dim{R n KJ, > i, i = l,... ,k\. 
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(Over a point, say, the interiors of the f2(a.)'s form a cellular decomposition of G' and 
respectively G" .) Here, the definition of the scheme structure is more delicate than in 
the previous two cases (roughly speaking, instead of minors one should use the Pfaffians 
of the "coordinate" antisymmetric matrix of G' and G"). We refer the reader for details 
to [L-Se] and references therein. 

The Schubert subvarieties 0(a.) in G' (resp. 0(a.) in G") are desingularized using 
the same construction as above but instead of the scheme one must now use the 
following scheme T' (resp. T"). Let T' = ^'(a.) ~ ^'{Va^ C . . . C Va,,) be a scheme 
parametrizing flags Ai C A2 C . . . C C ^fc+i such that rank Ai = i and Ai C I4. for 
z = 1, . . . , /c; rank Ak+i — n, Ak+i is isotropic and rank{Ak+i H Vn)x = n {mod 2) for 
any x & X . The definition of JF" = J^"{a,) is the same with exception of the last condition 
now replaced by: rank{Ak+i fl Vn)x = n + 1 {mod 2) for any x & X . Let p' : T ^ X 
(resp. p" : T ^ X) denote the projection maps. Of course, T' (resp. JF") now is a 
composition of the same flag bundle Fl and the even orthogonal Grassmannian bundle 
OG'^_^{C-^ /C) (resp. OG'^_i^{C^ /C)), where C is the rank k tautological subbundle 
on Fl and Vn/C is the rank n — k isotropic bundle used to define OG'^_^{C^ /C) and 
OGl_^{C^/C). 

The formula for dimension now is different: 

k 

dim T' = dim T" = ^^(^i — i) + {n — k){n — k — l)/2 + dim X. 

We finish this section with the following lemma which will be of constant use in this 
paper. 

Lemma 1.1. Consider cases 1., 2., 3. of a vector bundle endowed with a nondegenerate 
form $ that are specified in the Introduction. Let C G V be an isotropic subbundle and 
C"*- be the subbundle ofV consisting of all v eV such that $(f , c) = for any c E C. 

1. Then one has an exact sequence 

^ ^ F ^ 

where the map cf) is defined by v ^ $(f,— ). In particular, in the Grothendieck group, 
[V] = [C^] + [C^], [C^/C] = [V] - [C] - [C^] and the Chern classes ofC^/C are the 
same as the ones of \y] — [C ® C^] . 

2. Assume now that C is a maximal isotropic subbundle of V . Then in cases 1. and 
3. we have C — C"*- and c,{V) = c (C ® C^); in case 2. one has rank{C-^ /G) = 1 and 
2c. (V) = 2c.(C©C^). 

The latter equality of assertion 2 in case 2. follows from the fact that the form $ 
induces an isomorphism (C-'-/C)®^ = Ox- This assertion will be used in the proof of 
Theorem 5.14 and 5.15 and is well suited for this purpose because of the appearance of 
the factor "2"" on the right hand side of the formulas of the theorems. 
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2. Isotropic Schubert Calculus and the class of the diagonal 

Let us first recall the following result on Lagrangian and orthogonal Schubert Calculus 
from [PI, 2]. 

We need two families of polynomials in the Chern classes of a vector bundle E over 
a smooth variety X. Their construction is inspired by I. Schur's paper [S]. The both 
families will be indexed by partitions (i.e. by sequences / = (zi ^ . . . ^ ^ 0) of 
integers). Set, in the Chow ring A*{X) of X, for i ^ j ^ 0: 

_ 3 

QijE := CiE ■ CjE + 2 q+^E • Cj_pE, 

p=i 

so, in particular QiE :— Qi^E — CiE for i ^ 0. In general, for a partition / = 
(zi, . . . , Zfe), A;— even (by putting = if necessary), we set in A*{G): 

QiE:=Pf(Q,^^,E) 

where P f means the Pfaffian of the given antisymmetric matrix. For the definition and 
basic properties of Pfaffians we send interested readers to [A], [Bou] and [B-E, Chap. 2]. 
Also, we refer the reader to the beginning of Section 4 for an alternative recurrent 
definition of QiE: just replace the polynomial Qi{Xn) from Section 4 by the element 
QiE. 

The member of the second family, associated with a partition /, is defined by 

PiE := 2-^^^^QiE. 

Observe that in particular P^E = CiE/2 (so here we must assume that CiE is divisible 
by 2), and 

_ _ _ j-i _ _ 

PijE = P,E ■ PjE + 2 J2{-^fPi+pE ■ Pj-pE + {-lyPi+jE. 

p=i 

It should be emphasized that Q- and P-polynomials are especially important and 
useful for isotropic (sub)bundles. 

The following result from [PI, (8.7)] and [P2, Sect. 6], gives a basic geometric inter- 
pretation of Q- and P-polynomials. (It can be interpreted as a Giambelli-type formula 
for isotropic Grassmannians; recall that a Pieri-type formula for these Grassmannians 
was given in [H-B] - consult also [P-Rl] for a simple proof of the latter result.) 

Theorem 2.1. [P2, Sect.6] 

(i) Let V he a 2n— dimensional vector space over a field K endowed with a nondegen- 
erate symplectic form. Then, one has in A*{LGnV), 



[n{a)] = QiR 
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where R is the tautological subbundle on LGnV and ip = n + 1 — ap, p = 1, . . . ,k. 
(a) Let V be a (2n+ 1) — dimensional vector space over a field K of char. ^ 2 endowed 
with a nondegenerate orthogonal form. Then, one has in A*{OGnV), 

[n{a.)] = PiR"" , 

where R is the tautological subbundle on OGnV and ip — n + 1 — ap, p — 1, . . . , k. 
(Hi) Let V be a 2n— dimensional vector space over a field K of char. ^ 2 endowed with a 
nondegenerate orthogonal form. Then one has in A*{OG'^V) (resp. A*{OG'^V)), 

[n{a)\ = PiR"" , 

where R is the tautological subbundle on OG'^V (resp. OG"V) and ip = n — ap, 
p — l,...,k. ( Notice that the indexing family of I 's runs here over all strict 
partitions contained in Pn-i- ) 

Observe that by Lemma 1.1, R^ is the tautological quotient bundle on LGnV, 
OG'^V and OG'^V . Moreover, the Chern classes of the tautological quotient bundle 
on OGnV and R^ are equal. 

Note that this result has been reproved recently by S. Billey and M. Haiman in [B-H]. 

Assume now that V is a vector bundle over a smooth variety X and V. is a flag of 
isotropic bundles on X . Then, using Noetherian induction, one shows that {<5/-R^}/cp„ 5 
{P/i?^}7cp„ and {P/i?^}7cp„_i are A*(X)-bases respectively oiA*{LGnV), A*{OGnV) 
and A*{OG'^V) (resp. A*{OG'^V)). Moreover, there is an expression for il{a.; V.) as a 
polynomial in the Chern classes of i?^ and Fj. (This follows, e.g., from the existence 
of desingularizations given in Section 1 and formulas for Gysin push forwards - for 
"usual" flag bundles they are obtained by iterating a well known projective bundle case; 
for isotropic Grassmannian bundles, they are given for the first time in Section 5 of the 
present paper). Then the maximal degree term in c.(i?^) of this expression, in respective 
cases (i), (ii), (iii), coincides with that in Theorem 2.1. We will call it the dominant term 
(w.r.t. R). 

Let G\,G2 be two copies of the Lagrangian Grassmannian bundle LGnV over a 
smooth variety X, equipped with the tautological subbundles Ri and i?2- Write GG := 
Gi G2 ■ Consider the following diagonal 

A={{g„g2)eGG\ ((i?i),,)^ ={{R2)aa), \ 

K (91,32) (91,32) ) 

Our goal is to write down a formula for the class of this diagonal. We first record: 

Lemma 2.2. Let G be a smooth complete variety such that the "x-map" (cf. [F, end of 

Sect.l]) gives an isom,orphism A*{G x G) = A*{G) ® A*{G) . Assume that there exists 
a family {&a} ; £ A^°'{G) , such that A*(G) = ©Z6q, , and for every a there is a 
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unique a' such that Ua + ria' = dim G and ba ■ ba' . Suppose b^ ■ b, 
Then the class [A] in A* (G x G) is given by ^b^ x • 



a 



= 1 . 



a 



Proof. It follows from the assumptions that in A*{G x G) , [A] = 'Y^rriapba x bp , for 
some integers moip and + = dim G for all pairs (ct, {3) indexing the sum. We 
have by a standard property of intersection theory for g,h & A*{G) 



The latter expression, according to our assumption is not zero only if a' = {(3')' i.e. 
P = a', when it equals 1. This proves the lemma. □ 

For a given positive integer k, put pk = {k, k — 1, ... ,2,1) . For a strict partition 
/ C pfc ii ^ k, i2 ^ k — 1, . . .) we denote by \ / the strict partition whose parts 
complement the parts of / in the set {k, k — 1, . . . ,2, 1}. 

The Lagrangian Grassmannian (over a point, say) satisfies the assumptions of the 
lemma with {Qz-R^jg^^j^^ j^-p pl^iying the role of {b^} and for a = / we have a' = 
Pn \ /• This is a direct consequence the existence of a well known cellular decomposition 
of such a Grassmannian into Schubert cells and the results of [P2] recalled in Theorem 
2.1(i) together with a description of Poincare duality in A*[LGnV) from loc.cit. Thus 
in this situation we get by the lemma: 

Lemma 2.3. The class of the diagonal A of the Lagrangian Grassmannian equals 



the sum over all strict I d Pn ■ 

We now want to show that the same formula holds true for an arbitrary smooth base 
space X of a vector bundle V . Our argument is based on the following result expressing 
the class of the (relative) diagonal in terms of Gysin maps. This result was due to the first 
author in [P3, Sect. 5] and is accompanied here by its proof for the reader's convenience. 

Lemma 2.4. [P3] Let it : G X be a proper morphism of smooth varieties such 
that TV* makes A*{G) a free A*{X)-module, A*{G) = ®aef^^*{X) ■ ba, where b^ G 
A"'"(G) and for any a there is a unique a' such that + n^' — dim G — dim X 
and TT^{boi ■ ba') 7^ 0; suppose 7r^{ba • &«') = 1- Moreover, denoting by Pi : G G ^ 
G (i — 1,2) the projections, assume that, for a smooth G x^ G, the homomorphism 
A*{G) A*{G) A*{G G), defined by g <S> h ^ p\g -p^h, is an isomorphism. 

Then 




Hence the coefficients map satisfy: 
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(i) The class of the diagonal A inG G equals [A] = pT^apba ® bp, where, 
for any a,P, ruap = Pap{{'^*{bK ■ bx)}) for some polynomial Pap e Z[{xka}]- 
(a) If 7r^{ba • bp) 7^ iff (3 = a' , then the class of the diagonal A G G x ^ G equals 
[A] =E^6a®6«'. 

Proof. Denote by 5 : G ^ G x^ G, 5' : G —>■ G x ^ G (the Cartesian product) the 
diagonal embeddings and by 7 the morphism ttx^tt: Gx^G^X. For g,h E A*{G) 
we have 

7T^{g-h) = 7T^(^{S')*{gxh)^ =TT^(^6*{g(^h)^ = -fj^[6*{g h)^ = ^^(^[A] ■ {g h)^, 

using TT = 7 o 5 and standard properties of intersection theory ([F]). Hence, writing 
[A] = J2 T^fj-vb^ (^bty,we get 

'7^*{ba ■ bp) = 7* ([A] • {ba <8) bp) = (tt* (8) tt*) rrii^^b^ (g) b^) ■ {ba (8) bp)^ 
= ^rni^i,n^{b^ ■ ba) ■ n*{b„ ■ bp). 

(i) By the assumption and (*) we get 

(**) = 7r*(6a' • 6/3') - ^ mi^u'n*{b^ ■ ba') ■ 'n*{bu ■ bpi). 

where the degree of m^i, G A*{X) such that [x ^ aoxv ^ (5 and Tv^,{b^-ba')-Tv*{b^-bpf) 7^ 0, 
is smaUer than the degree of niap. The assertion now foUows by induction on the degree 
of map. 

(ii) By virtue of the assumption, Equation (**) now reads 7r*(6a/ - bp/) — rUap and 
immediately implies the assertion. □ 

Let us remark that in [DC-P, Proposition 2], where a weaker variant of Theorem 9.6 
of the present paper is used, already assertion (i) (plus results of Section 5) are sufficient 
to conclude the proof. 

Let now G — LGnV — > X denote a Lagrangian Grassmannian bundle. 

Proposition 2.5. The class of the diagonal of the Lagrangian Grassmannian bundle in 
A*{G x^ G) equals 

[A] =J2Qi{Ri)gg ■ Qp^^i{R^)gg, 

the sum over all strict I C pn, GG = G x ^ G and Ri, i = 1,2, are the tautological 
(sub)bundles on the corresponding factors. 

Proof. The assertion follows from Lemma 2.4(ii) applied to 6/ = QjR^ {I strict C Pn) 
and Theorem 5.23(i) which will be proved (independently) later. □ 
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Corollary 2.6. With the notation of Section 1 and GT \= G T, the class of Z in 
A*{GT) (i.e. the image of the class of the diagonal of G G via (1 x a)*) equals 

strict iCpn 

Thus the problem of computing the classes of the 0(a.)'s is essentially that of calcu- 
lation p^{QiD'^) where p : JF — ;> X is the projection map; then we use a base change. 

Consider now the case of the orthogonal Grassmannian parametrizing rank n sub- 
bundles of V, where rank V — 2n + 1. The results of Lemma 2.3, Proposition 2.5 and 
Corollary 2.6 translate mutatis mutandis to this case with Q-polynomials replaced by 
P-polynomials (using essentially Theorem 5.23(ii) ). Thus the problem of computing the 
classes of the f2(a.)'s is essentially that of calculation p^{PiD^) where p : T ^ X is the 
projection. 

Finally, consider the even orthogonal case. Supppose that V is a, vector bundle of 
rank V = 2n endowed with a nondegenerate orthogonal form. Let G = OG'^V or G — 
OG'^V following the notation of Section 1. The even orthogonal analog of Proposition 
2.5 and Corollary 2.6 is obtained using Theorem 5.23(iii) and reads as follows: 

Proposition 2.7. The class of the diagonal of the Grassmannian bundle in A*{Gx^ G) 
equals 

[A] = Y,Pi{RX)gg ■ Pp^.,~.l{R^)GG, 

the sum over all strict I C Pn-i, GG = G x^ G and Ri, i = 1,2, are the tautological 
(sub)bundles on the corresponding factors. WithGT := Gx^T' (resp. GT := Gx^!F" ), 
the class of Z in A*(GT) (i.e. the image of the class of the diagonal of G x^ G via 
(1 X a)*) equals 

strict JCpri-i 

Thus the problem of computing the classes of the 0(a.)'s is essentially that of calcu- 
lation p'^[PiD^) and p'l{PiD^) where p' : T' ^ X and p" : T" — > X are the projection 
maps. 

3. Subbundles intersecting an n-subbundle in dim ^ k 

We will now show an explicit computation in case a. = (n — /c -|- 1, . . . , n) . This 
computation relies on a simple linear algebra argument. Another proof of Proposition 
3.1, using the algebra of divided differences, will be given in Section 8. 

We start with the Lagrangian case and follow the notation from Section 1. 

Proposition 3.1. Assume o. = {n — k+1, . . . ,n) . Let I (Z Pn be a strict partition. If 
(n, n— 1, . . . , A;-|-l) (t I, then p^QjD^ = . In the opposite case, write I = (n, n—1, . . . , 
k + . . . where ji > and I ^k . Then p^QiD"^ = Qj^,... ,jiV^ . 

Proof. It suffices to prove the formula for a vector bundle V ^ B endowed with a 
symplectic form, X equal to LGnV and Vn equal to the tautological subbundle on LGnV. 
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(Recall that Q{n — k + 1, . . . ,n;V.) depends only on Vn ; more precisely, it parametrizes 
Lagrangian rank n subbundles L of V such that rank{L fl Vn) k .) The variety 
in this case parametrizes triples (L, M, N) of vector bundles over B such that L and N 
are Lagrangian rank n subbundles of V and M is a rank k subbundle of L fl A^. Let W.: 
Wi C W2 C . . . C Wn be a flag of Lagrangian subbundles of V with rank Wi — i. For a 
partition J = (ji > . . . > > 0) C , 

aj = n{n+l-ji,... ,n+l-ji;W.) = {L e X\ rank{LnWn+i-jJ ^ h, h = 1, ...,/} 

defines a Schubert cycle whose class has the dominant term (w.r.t. Vn) equal to QjV^ e 
A*{X). It is well known that aj is an irreducible sub variety of X provided B is irre- 
ducible. 

Similarly, for a partition I = {ii > . . . > ii > 0) <Z Pn, q : J- ^ LGnV the projection 
on the third factor, 

Ai = q*n{n + ,n+l-ii;W.) = 



defines a cycle whose class has the dominant term (w.r.t. D) equal to QiD^ G A*(jF). 
Also, Aj is an irreducible subvariety of provided B is irreducible. 

We will show (the push-forward is taken on the cycles level) that: 

1) If / 7^ (n,n — 1, /c -I- 1) then p^Aj = 0. Passing to the rational equivalence 
classes, this implies p^^QjD^ = 0. 

2) If / D (n,n - 1, -I- 1) i.e. I = {n,n - 1, . . . ,k + 1, ji, . . . ,ji), where ji > 
and / ^ k, then p^Ai = aj where J = (ji, ...,ji). Then, passing to the rational 
equivalence classes (and using the projection formula), we get the following equality 
involving the dominant terms: p^QjD^ — QjV^. 

Observe that 1) holds if /(/) ^ n — k because we then have codim^Ai = \I\ < 
n-|-(n — l)-|-...-|-(A;-|-l), which is the dimension of the fiber of p. We will need the 
following: 

Claim Let / C Pn be a strict partition. Let / = card{h \ in-k+h 7^ 0}. Assume that 
I > 0. Then one has 



Indeed, for (L, N) E Aj, since rank{L O N) ^ k, the inequality rank{N fl Wr) ^ h 
implies rank{L n Wr) ^ h — {n — k) for every h,r; this gives (*). 

1) To prove this assertion we first use (*) (by the above remark we can assume that 
1{I) > n — k) and thus get 

codim^Ai-codim^p{Ai) ^ + . . . + in-k+i) - {in-k+i + ■ ■ ■ + in-k+i) =ii + -- ■ + in-k- 



{{L,M, N) e T\ rank{NV\W., 



n+l-i;j 



) ^ /i, h= 1, ...,/} 



(*) 



p{Al) C OLi, 
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Then, since I ^ (n, n — 1, . . . , + 1), we have 

zi + . . . + %n-h < n + . . . + (/c + 1), 

where the last number is the dimension of the fiber of p. Hence comparison of the latter 
inequality with the former yields p*^/ = 0. 

2) To prove this, it suffices to show C cu j, dim Aj = dim aj; and if p^Aj = d - aj 

for some (i G Z then d = 1. We have: 

p{Ai) C ctj : this is a direct consequence of (*). 

dim Aj = dim aj : this results from comparison of the following three formulas 
dim J-' — dim X + k{n — k) + {n — k){n — k + l)/2, codim-^aj = \J\, a,nd codimy^Aj = 
n+ . . . + {k + 1) + \J\. 

Therefore p^Aj = d ■ aj for some integer d. To show d = 1 it suffices to find an 
open subset U G aj such that p\p-iu : p~^U ^ t/ is an isomorphism. Wc define the 
open subset U in question as aj \ Q{n — k;W.). More explicitly, U is defined by the 
conditions: 

rank{L ^1, . . . , rank{L fl Wn+i-ji) ^ I and L n Wn-fc = (0). 

Observe that these conditions really define an open nonempty subset of aj because 
n{n + 1 - ji, . . . ,n + 1 - ji;W.) n{n + 1 - {k + l);W.) for J C pk- (RecaU that for 
/ = (n > . . . > i/ > 0), J = (ji > . . . > ji' > 0) one has Q{n+l-ii, . . . ,n+l-ii; W.) C 
n{n + l-ji,...,n+l-jir,W.)iSlDJ.) 

Since our problem of showing that (i = 1 is of local nature, we can assume that 
S is a point and deal with vector spaces instead of vector bundles. Let us choose 
a basis ei, . . . , e^, /i, . . . , fn such that, denoting the symplectic form by $, we have 
$(ei,ej) = = ^{fi,fj) and ^{ci, fj) = —^{fj,ei) = 6ij. Assume that Wi is generated 
by the first i vectors of {e^}. Let be the subspace generated by the last i vectors of 
{cj}. Moreover, let Wi be the subspace generated by the first i vectors of {/,} and 
be the subspace generated by the last i vectors of {fj}. 

Observe that for a strict partition pn D I D (n, n — 1, . . . , A; + 1) a necessary condition 
for "(-, -, N) e Aj" is "N D Wn-k" ■ (This corresponds to the first (n - k) Schubert 
conditions defining Aj.) On the other hand, ii L E U then L fl Wn-k — (0) and 
consequently L must contain Wn-k (from the rest, i.e. W^ © W^^ we can get at most 
A;— dimensional isotropic subspace). Hence also \L fl {W^ ® W^^\ = k (| — | denotes 
the dimension). We conclude that a necessary choice for an n-dimensional Lagrangian 
subspace N such that (L, M, N) e Aj for some M, is 

N := Wn-k®Lr\{W'' ®W''). 

It follows from the above discussion that N is really a Lagrangian subspace of dimension 
n and it satisfies the first (n — k) Schubert conditions defining Aj. N also satisfies the last 
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I k) Schubert conditions defining Aj : since \L fl Wn+i-j,^ \ ^ h and L fl Wn-k — (0), 
we have \N n Wn+i-jf^ \ = \ Wn-k \ + h^n — k + h for h = 1, . . . ,1. 

Moreover, since \L f] N\ = k, the subspace M above is determined uniquely: M = 
LDN. 

Summing up, we have shown that d = 1; this ends the proof of 2). 
Thus the proposition has been proved. □ 
Proposition 3.2. One has in A*{G), 

[n{n-k+l,...,n-l,n)]= J] Qi{V;^)g ■ Qp.^iiR'') • 

strict I<Zpk 

Proof. This formula is obtained directly by pushing forward via (pi)* the class of Z in 
A*{GT) given by 

strict iCpn 

(see Corollary 2.6), with the help of Proposition 3.1. □ 

Example 3.3. For successive k (and any n) the formula reads (with D — Dqj^, R = 
Rgj" for brevity): 

k=l QiD^ + QiR''; 

k=2 + ■ QiR'' + QiD'' ■ Q2R'' + Q21R''; 

k=3 + Qs2D''^QiR'' + QsiD"" ■^Q2R'' + ■ Q^R"" + Q^D'' ■ Q2iR^ + 

Q2D'' ■ Q^iR^ + QiD^ • Q32R^ + Q321R''. 

In the odd orthogonal case, the analogs of Propositions 3.1 and 3.2 are obtained by 
replacing Q-polynomials by P-polynomials. 

Proposition 3.4. (i) Assume a. = (n — /c + 1, ... ,n). Let I C Pn be a strict partition. If 
(n, n — 1, . . . , k+1) ^ /, then p^PiD"^ = . In the opposite case, write I — {n, n—1, . . . , 
k + 1, ji, . . . where ji > and I ^k . Then p^PiD^ = P^^,... ^j^V^ . 
(ii) One has in A*{OGnV), 

[l)(n-fc + l,...,n-l,n)]= ^ Pi{V^)g ■ Pp.^i{R'') • 

strict iCpk 

Assertion (ii) follows from (i) like Proposition 3.2 follows from Proposition 3.1. The 
proof of (i) is essentially the same as the one of Proposition 3.1. More precisely, in the 
proof of (i), a J and Aj are defined in the same way as in the proof of this proposition. 
Also, the whole reasoning is the same, word by word, except of the following one point. 
To prove that d = 1 one chooses now a basis ei, . . . , e^, /i, . . . , /n, g such that denoting 
the orthogonal form by $, we have $(ei,ej) = ^{fi, fj) = ^{ei,g) = ^{fj,g) = 0, 
^(ei,fj) = $(/j-,ei) = 5i^j and ^{g,g) = 1. Then Wi, W\ Wi and defined like in 
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the proof of Proposition 3.1 allow us to show that d = 1 exactly in the same way as in 
the proof of this proposition. 

Let us pass now to the even orthogonal case. So let V ^ X {X is connected) be a 
rank 2n vector bundle endowed with a nondegenerate quadratic form. Fix an isotropic 
rank n subbundle Vn of V. Recall that for A; = n {mod 2) hy p' : J^' ^ X we denote the 
flag bundles parametrizing flags Ai C A2 of subbundles of V such that rank Ai = A;, 
rank A2 = n, Ai C. Vn and A2 is isotropic with dim{A2 H Vn)x = n {mod 2) for every 
X & X. Similarly, for k = n + 1 {mod 2) by p" : JF" ^ X wc denote the flag bundle 
parametrizing flags Ai C A2 of subbundles of V such that rank Ai = k, rank A2 — n, 
Ai C Vn and A2 is isotropic with dim{A2 fl Vn)x = n + 1 {mod 2) for every x E X. 

In the even orthogonal case the analog of Proposition 3.1 reads: 

Proposition 3.5. Let I C Pn-i be a strict partition. If {n — l,n — 2, . . . ,k) <^ I then 
p'^PjD^ = 0. In the opposite case, write I = (n — 1, n — 2, . . . ,k,ji,... where ji > 
and I ^ k — 1. Then 

p'.PiD^ = Pn,...,nV:(. 
The same formula is valid for p'^. 

Proof. We consider flrst the case of p'^ i.e. k = n {mod 2). It suffices to prove the 
formula for a rank 2n vector bundle V ^ B (we assume that B is irreducible) endowed 
with a nondegenerate orthogonal form, X equal to OG'^V or OG'nV and Vn equal to the 
tautological subbundle on X. Then the variety !F' parametrizes triples {L,M,N) such 
that dim{L fl N)ij = n {mod 2) for every b E B (i.e. L and N either belong together to 
OG'^V or together to OG'^V) and M is a rank k subbundle of L n TV. 

We will now prove the proposition for X = OG'nV. (Obvious modiflcations lead to 
a proof in the case X = OG'nV.) Since the strategy of proof is the same as in the 
Lagrangian case, we will skip those parts of the reasoning which have appeared already 
in the proof of Proposition 3.1. Let W. : Wi C W2 C . . . C Wn be an isotropic flag in V. 

For J = {ji > . . . > ji > 0) C pk-i we deflne 

aj = 0(?i — ji, . . . ,n — ji; W.) if I = n {mod 2) and 

aj = Q{n ~ jij . . . ^n — ji,n;W.) if l = n + l{mod2). 

Similarly for / = (ii > . . . > > 0) C Pn-i, q ■ J^' ^ OG'^V the projection on the 
third factor, we deflne 

Ai = q*Vt{n — ii, . . . ,n — ii; W.) if I = n {mod 2) and 

Aj = q*fl,{n — ii, . . . ,n — ii,n;W.) if l = n + l{mod2). 

It is known that ccj and Aj are irreducible subvarieties provided B is. The dominant 
terms of the classes of aj and Aj are equal to PjV^ and PiD^ respectively. 

The proposition now follows from: 

1) HI :/) {n-l,n-2,... ,k) then p'^Aj = 0. 

2) If / D (n — 1, n — 2, . . . , /c) i.e / = (n — 1, n — 2, . . . , /c + 1, fc, ji, . . . , j/), where 
ji > and I ^ k — 1, then p'^Aj = aj where J = (ji, . . . 
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Assertion 1) (being obvious if < n — k) is a consequence of: 

Claim: For every strict partition / C Pn-i, let I = card{h\ in-k+h 0}- Assume that 
I > 0. Then one has 

(*) C 

Inclusion (*) also implies p'{Ai) C aj in 2). The equality dim p' {Aj) = dim cxj now 
follows from: dim T' — dim X + k{n — k) + {n — k){n — k — 1) /2, codim^aj — \J\ and 
codim^, Ai = {n — 1) + . . . + k + \ J\. 

Therefore p'^,AI = d • aj for some integer d. To prove that d = 1 it is sufficient to 
show an open subset U C aj such that p'\{p')-iu'- {p')~^U — > t/ is an isomorphism. The 
open subset U in question parametrizes those L e aj for which L fl Wn-k = (0). 

The problem being local, we can assume that S is a point. Let ei, . . . , e^, /i, • • • , fn 
be a basis of V such that denoting the form by $ we have $(ei,ej) — ^{fi, fj) = 0, 
$(ei, fj) = ^{fj,ei) = Sij and Wi is spanned by ei, . . . , e^. Define VT*, Wi and as 
in the proof of Proposition 3.1. 

Now, given L ^ U, the unique N such that (L, M, A^) e A/ for some M, is defined 
also as in the proof of Proposition 3.1: N := Wn-k ®Ln {W'' W''). 

This N is isotropic and satisfies the first n — k Schubert conditions because it contains 
Wn-k- Moreover, it satisfies the last k — 1) Schubert conditions defining Aj: since 
|L n Wn-j,, I ^ h and L fl Wn-k = (0), we have | A n Wn-j^ \ = \Wn-k \ + h^n-k + hior 
h — 1, . . . , Finally, the M above is determined uniquely: M — L fl A, and p'\[p')-iu 
is an isomorphism. 

We next consider the case oip'^, i.e. k = n + 1 {mod 2). It suffices to prove the formula 
for a rank 2n vector bundle V ^ B {B is irreducible) endowed with a nondegenerate 
orthogonal form, X equal to OG'^V or OG'^V and Vn equal to the tautological subbundle 
on X. Then the variety J-'" parametrizes triples {L,M,N) such that dim{L fl A);, = 
n + 1 {mod 2) for every b E B (i.e. L and A belong to different components OG'^V and 
OG'^V) and M is a rank k subbundle of L fl A. 

We will prove the proposition for X = OG'^V. (Obvious modifications lead to a proof 
in the case X = OG'^V .) Let W: : Wi C C . . . C W„ be an isotropic flag in V. For 
J = {ji> . . ■> ji> ^) C pk-i we define 

a J = Q{n — ji, . . . ,n — ji; W.) if I = n + 1 {mod 2) and 

aj = Q{n - ji,. . . ,n - ji,n;W.) if l = n{mod2). 

Similarly for / = (zi > . . . > > 0) C Pn-i; Q : T" — > OG'^ the projection on the 
third factor, we define 

^/ = q'*f2(n — H, . . . , n — z/, n; W!) if I = n + 1 {mod 2) and 

Aj = q*Q,{n — ii, . . . ,n — ii;W.) if l = n{mod2). 

The dominant terms of the classes of aj and Ai are equal to PjV^ and PiD^ respec- 
tively. The proposition now follows from: 

1) If / 75 (n - 1, n - 2, . . . , /c) then p'lAj = 0. 



21 



2) If 7 D {n — l,n — 2, . . . ,k) i.e / = {n — l,n — 2, . . . , k + 1, k, ji, . . . where 
ji > and I ^ k — 1, then p'^Aj = aj where J = (ji, . . . ,ji). 

The proof of these assertions is analogous to the one above. For every strict partition 
/ C pn-i and I = card{h\ in-k+h 7^ 0} > 0, one has p"{Ai) C aj^.^+i,... 
which imphes 1) and p"{Ai) C aj in 2); moreover, for the dimensions reasons we have 
p"Ai = d ■ aj for some integer d. One finishes the proof like in the case of p'^, by 
showing that p"\{p")-iu- ip")~^U — > ?7 is an isomorphism, where an open subset U C aj 
parametrizes those L e aj for which L fl Wn-k = (0). Hence d = 1 and the proof is 
complete. □ 

Proposition 3.6. If k = n {mod 2) (resp. k = n + 1 {mod 2) ) then one has in 
A*{OG'^V) (resp. inA*{OG':^V) ), 

[n{n - A; + 1, . . . , n - 1, n)] = J] ^/(Og • Pp,_,./(i?^). 

strict I<Zpk-i 

Proof. This formula is obtained directly by pushing forward via p'^ (resp. p'^) the class 
of Z in A*{GT) given by 

strict 7Cpn-i 

where = G (resp. GJ^ = G T") , using Propositions 2.7 and 3.5. □ 

4. Q-polynomials and their properties 

In this section we define a family of symmetric polynomials modelled on Schur's Q- 
polynomials. In Schur's Pfaffian-definition (see [S]), we replace Qi by - the z-th 
elementary symmetric polynomial. After this modification one gets an interesting family 
of symmetric polynomials Qi (indexed by all partitions) whose properties are studied 
in this section and then applied in the next ones. It turns out that Qi is the Young 
dual (in sense of the involution u> of [Mcdl, 1.2.(2.7)] to the Hall-Littlewood polynomial 
Qi{Y; q) where the alphabet Y is equal to X^/ (1 — q) in the sense of A-rings, specialized 
with q = —1 ([L-L-T], [D-L-T]). Though most of the properties of the Qj given in this 
section can be deduced from the theory of Hall-Littlewood polynomials, we give here 
their proofs using the Pfaffian definition. The only exception is made for the Pieri-type 
formula which is deduced from the one for Hall-Littlewood polynomials. 

Let X = {xi, X2, ■ ■ ■) be a sequence of independent variables. Denote by Xn the 
subsequence {xi, . . . ,Xn)- We set Qi{Xn) := ei{Xn) - the z-th elementary symmetric 
polynomial in X„. Given two nonnegative integers i,j we define 

Qiji^n) = Qi{^n)Qj{^n) + '^'^^{~^)^Qi+p{^n)Qj-pi^n) 
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Finally, for any (i.e. not necessary strict) partition I = [ii ^ ^2 ^ • • • ^ ^fc ^ 0), with 
even k (by putting z/. = if necessary), we set 



Ql{Xr,) = Pf{Qi^,i^{Xr,))^ 



Eqiiivalently (in full analogy to [S, pp. 224-225]), Qi{Xn) is defined recurrently on Z(/), 
by putting for odd /(/), 

1(1) 

and for even Z(/), 

1(1) 

{**) Ql{Xn) = 5^(-l)^Qn,^.(^n)Q7v{u,^,}(^n)• 

The latter case, with I = can be rewritten as 

i-i 

(* * *) QiiXr,) = Y,{~^y~^Qi,M{Xn)Ql\{i,M}iXn). 

i=i 

Note that assuming formally ii = 0, the relation (***) specializes to (*). We will refer 
to the above equations as to Laplace- type developements or simply recurrent formulas. 
(Invoking the raising operators i?^ ([Mcdl,I], [D-L-T]) the above definition is rewritten 

QiiXn) = \{\^ej{X^), 

i<j ^-^ 

where ei{Xn) is the product of the elementary symmetric polynomials in X„ associated 
with the parts of /.) 

We start with a useful linearity-type formula for Q-polynomials. 

Proposition 4.1. For any strict partition I one has 

j=0 \I\-\J\=j 

where the sum is over all (i.e. not necessary strict) partitions J <Z I such that 1/ J has 
at most one box in every row. 

Proof. We use induction on /(/). 

1° — 1. Since we have: ej(X^) = ej(X^_i) + a;„ei_i(X^_i), the assertion follows. 
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2° = 2. We have for i > j > and with = ej(X„), = ei{Xn-i),e-i — 0, 



= (eiCj + 2 X) (-lFei+pej_p) + Xn \(ei-iej + 2 X) (-l)^ei_i+pej_p) + 

\ p^i / L\ / 

+ (eiej_i + 2 X) (-l)^ei+pej_i_p) + (ei-iej-i + 2 ^ (-l)Pej_i+pej_i_p) 



— Qi,j(-^n-l) + <5i-l,j(-^n-l) + QiJ-l(-^n-l) + x'^Q -l{Xn-l) ■ 

3° By the remarks before the proposition, to prove the assertion in general it suffices to 
show it by using the recurrent relation (^***). (Note that the R.H.S. of the formula 
of the proposition specializes after the formal replacement ii := {I = to the 
expression asserted for (zi > Z2 > . . . > k-i)- 

So, let us assume that / is even and set Qi := Qi{Xn), Qi = Qi{Xn-i). Moreover, 
let V{I,j) be the set of all partitions J C I such that I\J has at most one box in 
every row and |/| — \J\ — j. We have by induction on I, 



r=0 \Jer(I\{ij,ii},r) 



Therefore, using 2° we have 

i-i 



Qi = Y^~^y ^ + Xn{Qij-i,ii + Qij,ii-i) + a;^Qi,._i,i,-i 



X 



1-2 



_r=0 JeV(I\{ijM,r) 

On the other hand, apply the relation (***) to the R.H.S. of the formula in the 
proposition. One gets: 

I I r i-i 

E<( E Qj)=T.^i E (E(^i)'"'^^..^v Oaow.}) 

i=o Jev(i,j) j=o Uer{i,j) g=i 

It is straightforward to verify that both these sums contain 2^(Z — 1) terms of the 
form 

( — 1) X-^ Qa,bQci,... ,ci-2J 

and such a term appears in both sums if and only if 

(ci, ... , Cs, a, Cs+i, ... , Q_2, b) e V{I, j). 
Thus the assertion follows and the proof of the proposition is complete. □ 
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Proposition 4.2. ; Qi,i{Xr,) ^ ei{xl, . . . , x^). 
Proof. By definition we liave (cj = ei{Xn))' 



2i 



Qi,i{Xn) — GiCi — 2ei_iei+i + 2ei+2ei-2 



p=0 



On tlie otiier tiand, witli an indeterminate t, we have 



(1 + Xit) . . . (1 + Xnt){l - Xit) ... (1 - Xnt) = (1 - xjt^) ... (1 - xlt^), 



or equivalently, 



J2{-iye,{xl...,xl)t^ 



which implies 



( . . . , x^) 



p=0 



Comparison of the latter equation with the first one gives the assertion. □ 

Proposition 4.3. For partitions I' — {ii,i2, ■ ■ ■ , j, j, ■ ■ ■ , ik-i, ik) o.nd I — (ii, . . . , ik), 
the following equality holds 



Proof. Write Qi for Qi{Xn). We use induction on k. For /c = 0, the assertion is 

obvious. For /c = 1, we have Qi,j,j — QiQjj and Qj,j,i = QjjQi by the Laplace type 
developements, so the assertion follows. 

In general, it suffices to show the assertion inductively, using the relation if the 

marked " j" does not appear on the last place; and independently, to prove it (inductively) 
for /' = (ii, . . . , ik, j, j). In both instances k is assumed to be even. 

In the former case, using (***) we get 



and the assertion follows from the induction assumption by using the relation w.r.t. 

Qii,...,ik once again. 

In the latter case we use the relation (**). We have 



and the assertion follows from the induction assumption by using the relation (**) w.r.t. 
Qii,...,ik once again. □ 



Ql'{Xn) = Qj,j{Xn)Ql{Xn). 




,3,3, ■■■ ,^k-2 




,^k-i,3,3 
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Lemma 4.4. Let I = (ii, ^2, • • • , h) be a partition. If ii > n then Qi{Xn) — 0. 

Proof. We use induction on For /(/) = 1,2 the assertion is obvious because 

ep{xi, . . . ,Xn) = for p > n. For bigger /(/) one uses induction on the length and 
the recurrent formulas, which immediately imply the assertion. □ 

Example 4.5. The following equalities hold: (in 1° and 2° we set Qj Qi{Xn) for 
brevity) 

1° Q5544441 = Q55Q44441 = Q55Q44Q441 = Q55Q44Q44Q1 = Q55Q4444Q1; 

2° <55554443331 = QbbQ'lAQssQbASl — <5554433Q5431 ; 

3° Here, we set Qi := Qi{xi,X2), Q'l := Qi{xi). Then 
Q32i(a^i,a;2,a;3) = 

= XSQ221 + 3^1(0211 + 022) + XIQ21 = XSQ22Q1 + xl{QiiQ2 + Q22) + XIQ21 

= X3e2{xl,xl){xi + X2) + xl [ei{xl, xl)xiX2 + e2{x\, x\)\ + xl{x2Q'ii + x\Q'^) 

= X2{XiX2){xi + X2) + x\ \{x\ + X2)xiX2 + x\x'^ + x\{x2x\ + X2X1) . 

By iterating the linearity formula for (Proposition 4.1), we get the following 

algorithm for decomposition of Qi = Qi{Xn) into a sum of monomials: 

1. If / is not strict, we factorize 

Qi — Qki,ki ' Qk2,k2 ■ • • • ■ Qki,ki ' Qli 

where L is strict (we use Proposition 4.3). 

2. We apply the linearity formula to Ql^Xti) and Xn. Also, we decompose 

Qk^,k^{Xn) = ek^{xl,... ,xl) 

_ (2 2\| (2 2 \ 2 

— ^kp \Xi, • ■ ■ , X^_i) -f- ekp-l[Xi, . . . , X^_i)X^ 

= Qkp,kp{Xn-l) + Qkp-l,kp-l{Xn-l)x'^. 

We then repeat 1 and 2 with the so obtained Q/(X^_i)'s, thus extracting Xn-i; then, 
we proceed similarly with the so obtained Q/(X„_2)'s etc. 

Note that if we stop this procedure after extracting the variables x^, x^-i, ■ ■ ■ , Xm+i we 
get a development: 

(*) Ql{Xn) = Qj{Xm)Fj{Xm+U ■■; Xn) , 

J 

where the sum is over J C / (this follows from the linearity formula; J are not necessary 
strict). 
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It follows from the above algorithm that Qi^Xj^) is a positive sum of monomials. It 
is, in general, not a positive sum of Schur /S-polynomials in X„ (we refer the reader to 
[Mcdl, I] and [L-Sl] for a definition and properties of Schur 5'-polynomials). Here comes 
an example computed with the help of SYMMETRICA [K-K-L]. 

Example 4.6. Let n = 5, Qi = Qi{X^) and sj = sj{X5). We have: 

<554 = ■§22221 Q53 = ■S222II Q52 = ■S22III Q5I = ■S2IIII 
Q43 — -S222I — -S22III Q42 — -S22II — -S2IIII Q4I = -S2III — -Slllll 

Q32 = S221 — •S2111 + Slim Q31 = S211 — siiii 

<521 = •S21 — Sill 

Q543 = S33321 — S33222 Q542 = S3322I — S32222 Q541 = S32221 — S22222 
Q532 = ^33211 — S3222I + S22222 Q53I = -532211 — -§22221 
Q52I = -S32III — -S222II 
Q432 = S332I — S3222 — S33111 Q43I = S322I — S32III — S2222 
Q42I = S3211 — S31111 — S222I 
Q32I = S321 — S3111 — S222 
Q5432 = S4432I — S44222 — S4333I Q543I = S4332I — S43222 — S3333I 
<55421 = -S4322I — -S42222 — -S3332I 
Q532I = S43211 — S4222I — S33311 
Q4321 = S4321 — S43III — S4222 — S3331 + S32221 — 2S22222 
Q54321 = S54321 — S54222 — S53331 — S44421 + S43332 — 2S33333. 

We denote by SV{Xn) the ring of symmetric polynomials in Xn- 

Proposition 4.7. The set {^/(-^n)} indexed by all partitions such that ii ^ n forms 
an additive basis of SV{Xn) . Moreover, for any commutative ring TZ, the same set is a 
basis of a free TZ-module SV{Xn) 7?.. 

Proof Let us compare the family {Qj{Xn)} with the 7^-basis {ei{Xn)} of SV{Xn) ^TZ, 
where / runs over all partitions such that ii ^ n (and for a partition / = (zi, ... ,ik) 
we write e/(X„) = eii(X^) • . . . • ei^,(X„)). Consider the reverse lexicographic ordering 
of [Mcdl, I] on the set of such partitions, inducing a linear ordering on the above set 
{ei{Xn)} . By the definition of Qi{Xn)., one has 

Qii^n) — ei{Xn) + (combination of earlier monomials in the ei(X„)'s). 

Since {ei{Xn)} is a 7?.-basis of SV{Xn) Tl, {Qi{Xn)} forms another 7?.-basis of 

sp{Xn)0n. □ 
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Corollary-Definition 4.8. For every m ^ n and any partitions J C I, there exist 
uniquely defined polynomials Qi/j{xm+i,--- ,Xn) £ SV{xm+i, ■ ■ ■ ,Xn) such that the 
following equality holds 

Ql{Xn) = ^ Qj{Xm)Ql/j{Xm+l, ■■■ , Xn) ■ 
JCI 

Proof. The existence of such polynomials Qj/j{xm+i, ■ ■ ■ , Xn) £ '^[xm+i, • • ■ , Xn] follows 
from the above discussion and (*); we put Qi/j := Fj. 

Since SV{Xn) C SV{Xm) ® SV{xm+i, • • • , Xn) and {Qj{Xm)\ ji ^ m} is a Z-basis 
of SV{Xm) (Proposition 4.7), we have the corresponding development: 

Ql{Xn) = ^ Qj{X^)Gj{Xm+l, Xn) ■ 
J 

Using Proposition 4.6 once again with n replaced by m and 71 = Z[xm+i, ■ ■ ■ ,Xn], we 
infer that Fj{— Gj) are symmetric in Xm+i-, ■ ■ ■ ,Xn (and defined uniquely). □ 

We will need also a family of P-polynomials in 5'P(X^) (8)Z[l/2] defined by Pi{Xn) '■= 
2~''^^'^Qi{Xn) for a partition /. Also, in analogy to the above, for every m ^ n and 
any partitions J <Z I there exists uniquely defined polynomials Pj/j{xm+i, ■ ■ ■ ,Xn) £ 
SV{xm+i, ■ ■ ■ ,Xn) <8) Z[l/2] such that 

Pl{Xn) = ^ Pl{Xm) Pl/j{Xm+l, ■ ■ ■ , Xn) ■ 
JCI 

P-polynomials satisfy properties which can be automatically gotten from the above es- 
tablished properties of Q-polynomials. For instance, an analogue of Proposition 4.1 for 
P-polynomials reads: 

1(1) 

Pi{Xn)=j:xi[ y: 2'(^^-'^^)p.(x._o) , 

j=0 \I\-\J\=j 

the sum as in Proposition 4.1. 

Given a rank n vector bundle E with the Chern roots (ri, . . . ,r„) we set QiE := 
Qi{Xn) and PjE :— Pi{Xn) with Xi specialized to r^. Note that this notation is 
consistent with that used in Section 2 and 3. Similarly, given a subbundlc E' G E 
with the Chern roots (r^+i,... ^r^), we define QjjjE' — Qi/j{xm+i,--- ,Xn) and 
Pj/jE' = Pj I j{xm+i, . . . , Xn) with Xi Specialized to r^. 

In the next section we will need the following Pieri-type formula for the Q/'s. 
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Proposition 4.9. Let I = {ii, ...,ik) be a strict partition of length k. Then 

where the sum is over all partitions (i.e. not necessary strict) J D I such that \ J\ = \I\+r 
and J/I is a horizontal strip. Moreover, m{I,r; J) = card{l < p < k\ jp+i < ip < jp} 
or, equivalently, it is expressed as the number of connected components of the strip J/I 
not meeting the first column. 

(A skew diagram D is connected if each of the sets {i : 3j{i,j) e D} and {j : 3j(z, j) e D} 
is an interval in Z.) 

Proof. Let after [L-L-T], Q'j{Xn;q) denote the Hall-Littlewood polynomial Qi{Y]q) 
where the alphabet Y is equal to — q) (in the sense of A-rings). Using raising 

operators Rij ([Mcdl,I] we have (see, e.g., [D-L-T]) 

i<j 

Specialize q — —1 and invoke the well known Jacobi-Trudi formula 

Si{Xn) = l[{l-Rij)hiiXn) 

i<j 

where hi{Xn) is the product of complete homogeneous symmetric polynomials in X„ 
associated with the parts of /. We have 

Q'i{Xn;-i) = ll\^hj{Xr,). 

i<j 

Therefore, denoting by to the Young duality-involution we get Qi{Xn) = co(^Q'j{Xn; — 1)) • 
The required assertion now follows by an appropriate specialization of the Pieri-type 
formula for Hall-Littlewood polynomials ([Mo], [Mcdl, IIL3.(3.8)]). □ 

5. Divided diflferences and isotropic Gysin maps; 
orthogonality of Q-polynomials 

Let y — > X be a vector bundle of rank 2n endowed with a nondegenerate symplectic 
form. Let tt : LGn{V) — > X and r : LFl{V) — > X denote respectively the Grassmannian 
bundle parametrizing Lagrangian subbundles of V and the flag bundle parametrizing 
flags of rank 1, rank 2, rank n Lagrangian subbundles of V. We have r = ttoco where 
u : LFl{V) — > LGn{V) is the projection map. The main goal of this section is to derive 
several formulas for the Gysin map tt* : A*{LGn{V)) — > A*{X). 

We start by recalling the Weyl group Wn of type Cn- This group is isomorphic to 
Sn K 1^2- We write a typical element of Wn as w = (cr, r) where a & Sn and r G 
so that if w' = {a', t') is another element, their product in Wn is w ■ w' = {a o a', S) 
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where "o" denotes the composition of permutations and 6i = T^'(i) ■ r/. To represent 
elements of Wn we will use the standard "barred-permutation" notation, writing them 
as permutations equipped with bars on those places (numbered with "i") where = —1. 
Instead of using a standard system of generators of Wn given by simple reflections Si = 
(1, 2, . . . , z + 1, i, . . . , n), 1 ^ i ^ n — 1, and s„ = (1,2,... , n — 1, rl), we will use the 
following system of generators S = {so = (1, 2, . . . , n), si, . . . , Sn-i} corresponding 
to the basis: {—2si),ei — £2,^2 — £3,---,£n-i — £n- It is easy to check that {Wn,S) 
is a Coxeter system of type Cn- This "nonstandard" system of generators has several 
advantages over the standard one: it leads to easier reasonings by induction on n and 
the divided differences associated with it produce "stable" symplectic Schubert type 
polynomials (for the details concerning the latter topic - consult a recent work of S. 
Billey and M. Haiman [B-H]). Let us record first the formula for the length of an element 
w = (a, t) G Wn w.r.t. S. This formula can be proved by an easy induction on l{w) and 
we leave this to the reader. 

n 

Lemma 5.1. l{w) = ai+ J2 i^^j + 1)? where ai := card\^p\ p > i Sz ap < CTj} and 

i=l T-j=-l 

bj := card\^p\ p < j ap < aj^ . 

In the sequel, whenever we will speak about the "length" of an element w G Wn, we 
will have in mind the length w.r.t. S. 

Let Xn = (xi, . . . ,Xn) be a sequence of indeterminates. 

We now define symplectic divided differences di : Z[X„] Z[Xn], z = 0, 1, 
setting 

^oif) = if-sof)/{-2x^) , 

diif) = if - Sif)/{xi- Xi+i) , i = l,...,n-l , 

where sq acts on Z[X„] by sending xi to —xi and Si - by exchanging Xi with Xi+i and 
leaving the remaining variables invariant. For every w G Wn, liw) = I, let s^^ ■ . . . ■ Si^ be 
a reduced decomposition w.r.t. S. Following the theory in [B-G-G] and [Dl,2] we define 
dw '■= dsi^ ■ . . . ■ dsi^ . By loc.cit. we get a well-defined operator of degree — /(/) acting on 
Z[Xn] (here, "well-defined" means: independent on the reduced decomposition chosen). 

We want first to study the operator dw^ where Wo = (1, 2, . . . , n) is the maximal 
length element of Wn- To this end we need some preliminary considerations. 

Let QV{Xn) denote the ring of Schur's Q-polynomials in Xn- We record the following 
(apparently new) identity in this ring. In 5.2 - 5.4 below we will write: = ej(X„), 
Si = si{Xn), Qi = Qi{Xn) and Qi = Qi{Xn) for brevity. 
Proposition 5.2. In QV{Xn), 

Qpk = Det{aij)i^ij^k, 

where aij = Qk+i+j-2i ifk + l+ j — 2i^0 (with Qi = for i < 0) and aij = 2 if 
k + l+j-2i = 0. 

Proof. We have from the theory of symmetric polynomials (see [P2] and the references 
therein), 

Qpk = S'^Sp, = Det(2ek+i+j-2i) - 
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It follows from the Fieri formula (see [Med] and [LSI]) that 

\ hooks I, J hooks J, 



\i\=i-i \j\=i 
Hence, by multiplying the p-th row by si and adding it to the (p— l)-th one successively 
forp = A;,A; — 1,... ,3, 2, the latter determinant is rewritten in the form: 

Det[2 ^ si 

\ hooks I, / ^ ^ . . ^ , 

Notice that the degree entries in this determinant are equal to 2 and the negative 
degree entries vanish. Since Qi = 2 ^ s/, the assertion follows. □ 

hooks I,\I\=i 

Let J be the ideal in SV{Xn) generated by ei{x\, . . . , a;^), 1 ^ z ^ n. We now invoke 
a corollary of [P2, Theorem 6.17] combined with [B-G-G, Theorem 5.5] and [D2, 4.6(a)]: 
there is a ring isomorphism SV{Xn) / J — > QV{Xn)/ © IjQi^Xn)-, where / runs over all 
strict partitions / ^ pn, given by ei{Xn) i— > Qi{Xn) (see the remark after Theorem 6.17 
in [P2, pp. 181-182]). We thus get from the proposition: 

Corollary 5.3. In SV{Xn), Qp^, is congruent to Det{bij)i^ij^k niodulo J , where 
bi,j — ek+i+j-2i if k + 1 + j — 2i ^ (with Ci — for i < 0) and bij —2 if 
k '+ 1 + j - 2i = 0. 

We now state: 

Lemma 5.4. In SV{Xn), Qp„ = CnCn-i . . . ei = Sp„ (mod J). 

Proof. By the corollary it is sufficient to prove that Det{bij)i^ij^ri = CnCn-i • • • ei = 
Sp^ (mod J). Recall that Sp^ = Det{cij)i^ij^n where = en+i+j-2i if n + l+j-2i 7^ 
and Cij = 1 if n-|- 1 +j — 2i = 0, i.e. the matrices (bij) and (cij) are the same modulo 
the degree entries. 

Let us write the determinants Det{bij) and Det{cij) as the sums of the standard n\ 
terms (some of them are zero). It is easy to see that apart from the "diagonal" term 
enCn-i • • • ei, every other term appearing in both sums is divisible by 6^6^-1 • ■ ■ Cp+iCp 
for some p ^ 1. We claim that, e„e„_i . . . Cp+iCp G J". Indeed, G JT" and suppose, by 
induction, that we have shown e„e„_i . . . Cg+iCg E for q > p. Then 

p 



^n^n—l • • • ^p+l^p — ^n^n— 1 • • • ^p+1 



Qp,p ~l~ 2 ^ ^ ( 1) Cp^iCp—i 



belongs to J' by the induction assumption, because Qp^p G (see Proposition 4.2). This 
shows that 

Det{bij) = CnCn-i . . . ei = Det{cij) [mod J). 
Thus the lemma is proved. □ 



The following known result (see, e.g., [Dl] where the result is given also for other root 
systems) is accompanied by a proof for the reader's convenience. 
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Proof. By the definition of dyj^ we infer tliat d^^ = ^ ct^w wliere tlie coefficients 

wew„ 

a^) are rational functions in xi, . . . ,Xn- Since Wo is tfie maximal lengtli element in 
di°dw^ = for all i = 0, 1, . . . , n — 1. Consequently Sidyj^ = d^^ for i = 0, 1, . . . , n — 1 and 
hence = d^^ for all v G Wn- In particular, for every v G VF^, = ^ f (ct^t,)t;?w. 

Thus a^-u] = '^(cKw) for all v,w & Wn, and we see that, e.g., a^^ determines uniquely all 
the QJuj's. 

Claim = (-i)n(n-i)/2 /'2n^^ ..... [] (^^f " a^J)) 

Proof of the claim: Denote now the maximal length element in Wn by • We argue by 
induction on n. For n = 1, we have ck^(i) = We now record the following equality: 

^(fc+l) ^ . • . . . • Si • So • Sl • . . . • Sfe-l • Sfc • tf^''^ 

that implies 

5 (fc+i) = 9a; o a/s-i o . . . o ^1 o ^0 o 5i o . . . o a/e-i od^o d (k) . 
It follows easily from the latter equality that 

a^(k+i) = {-\f{2xk+i\\{xi-Xk+i)\\{xi + Xk+i)^ Q!^(fe). 

This allows us to perform the induction step n — > n + 1, thus proving the claim. 
Finally, for arbitrary w G Wn, 

= wwoia^j = (^2-^1 ■ . . . ■ Xn Hl^? - ^?)) 

i<j 

because, for w = (o", r), 1{(J,t) = X^Oj + + 1) = K*^) + card{p\ Tp = — 1} 

{mod 2) (sec Lemma 5.1). □ 

Corollary 5.6. (i) dyu^{xi^X2^ . . . x^") = if ap is even for some p = 1, . . . ,n. 
(a) If all ap are odd then 

where here and in the sequel d denotes the Jacobi symmetrizer 

(5](-iy(-)a(-))/n(^i-^.)- 

aeSn i<j 



Proposition 5.5. One has for f G Z[Xn], 

i<j 
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Proof, (i) Let us fix cr e Sn and look at all elements of of the form [a, r) where 
T e Z2 . Then, writing for • . . . • x^"-, we have 

r T 

because 1{(J,t) = l{a) + card{p\ Tp — —1} {mod 2). Suppose that some numbers among 
ai, . . . ,an are even. We will show that this implies 

y~^(^_l^cord{p| Tp=-l}^ai ^ ^ ,^a„ _ q_ 

T 

We can assume that ai, . . . ,ak are odd and ak+i, ... , ctn are even for some k < n (by 
permuting the r^'s if necessary). We have 

■ 

T 

— ^^_]^^card{p| Tp = — 1, p>fc} 

T 

n—k 

(ii) Let us now compute d^^{x'^'^ . . .x^") where all ctp are odd. Then 

^(_l)cardO| r, = -l}^ai . . . = 3", and 

T 

= {-ir^''^^^'\2^X^...XnY[{xj-x])y\^ 



We now record the following properties of the operator V = df^^^^ 2,1)- the follow- 
ing, let J= J^Z[X^]. 

Lemma 5.7. (i) If f e SV{xl ...,xl) then V{f ■ g) = f ■ ^{g). 
rzz; v(Qp„(X„)) = (-ir(-+i)/2. 

Proof, (i) This assertion is clear because every polynomial in SV{x\,... , x^) is W"„- 
invariant. Observe that it implies that ii f = g (mod X) then V(/) = V(^) (mod X). 

(ii) (This can be also deduced from the Chow ring of the Lagrangian Grassmannian. 
Wc present here a direct algebraic argument.) In this part we will use the following 
properties of the Jacobi symmetrizer d (see [L-S2], [Mcd2]): 
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1. If / e SV{X^), g E Z[X^] then d{f ■ g) = f ■ d{g). 

2. For any a = (cti, . . . , ctn) G N"^, d{x°') = Sq,-p„_i (^n)- In particular, if ctj = aj for 
some i ^ j then 5(a;") = 0. 

3. d = 5(n,n-l,... ,!)• 

Let Cj = ei{Xn). Since Qp^{Xn) = e^e^_i . . . ei (mod X) (by Lemma 5.4), we have 
V(Qp„(X„)) = V(enen-i...ei) = (V o a)(a;^"-iene„_i . . . d). 
by properties 1 and 2 above. Since 



(n, n - 1, . . . , 1) o (n, n - 1, . . . , 1) = tuo, 

the latter expression equals 5iyo(a;''"-ie„e„_i . . .ei) by property 3. The degree of the 
polynomial x^^'^-'^enen-i . . . ei is n^. Assuming that ai+. . = n^, we have d^^ (a;") ^ 
only if 

™Q; _ 2n-l 2n-3 

~ ct(1) '^o-(2) • • • •^o-(n) 

for some cr e S'n. Indeed, it follows from Corollary 5.6(i) that dwo{x°') ^ only if all the 
ctj's are odd. Moreover, they must be all different; otherwise d{x'^) = (and consequently 
dwoi^"") = 0) by property 2. We conclude that {cti, . . . , = {2n — 1, 2n — 3, . . . ,1}. 
But there is only one such a monomial in x^"-^enen-i • • - Ci, namely the one with 
(q!i, . . . , an) = (2n — 1, 2n — 3, . . . ,1). Therefore 

by Corollary 5.6(ii) and property 2. □ 



We now pass to a geometric interpretation of the operator V. 

Proposition 5.8. Specializing the variables xi, . . . ,Xn to the Chern roots ri, . . . , r„ of 
the tautological subbundle R on LGnV , one has the equality 

7r,(/(ri,... ,rn)) = (%,7r3T,... ,2,1)/) ('^i' • • • ^^n), 

where /(— ) is a polynomial in n variables. 

(A symmetrization operator variant of this proposition follows also from a recent paper 
by M. Brion [Br]. We give here a short proof using only divided differences interpretation 
of Gysin maps for complete (usual and Lagrangian) flag bundles.) 

Proof. We invoke a result saying that the Gysin map associated with co and r is induced 
by the following divided differences operators: 

T*(/(ri,... ,rn)) = (%,2,...,n)/)(''i'-- - ^^n) and 

{f{ri, • • • , Tn)) = (d(n,n-l,... ,1)/) (^1, • • • , ^n)- 
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As for the latter equality, see [PI, Sect. 2] , as for the former compare [Br] where the 
author gives a symmetrizing operator expression for G/5-fibrations (over a point, say, 
this expression was given in [A-C]). The needed divided differences interpretation of those 
symmetrizing operators follows, e.g., from [Dl]. 
Since 

(T,2, ... ,n) = {n,n-l,... , T) o (n, n - 1, . . . , 1), 

we get 

%,2,... ,n) = ,T) ° ^(n,n-l,... ,!)• 

Of course, = tt^ o u^. Since a;* is surjective, comparison of the latter equation with 
the former implies the desired assertion about tt*. □ 

We now show how to compute the images via tt* of Q-polynomials in the Chern classes 
of . Let us write = {—xi, . . . , —Xn) for brevity. 

Proposition 5.9. One has V{Qi{X^)) ^ only if the set of parts of I is equal to 
{1,2,... , n} and each number p (1 ^ p ^ n) appears in I with an odd multiplicity rup. 
Then, the following equality holds in Z[X„], 

n 

p=l 

Proof. By Proposition 4.3 we can express Qi{X^) as 

where L is a strict partition. (We divide the elements of the multiset / into pairs of 
equal elements and the set L whose elements are all different.) Some of the jp's can be 
mutually equal. 

By Proposition 4.2, Qjj{X^) = ej(xf , . . . , x'^) is a scalar w.r.t. V. 
By Lemma 4.4, Ql{X^) ^ only if L C Pn- On the other hand, for a strict partition 
L C Pn, V{Ql{X^)) 7^ only if L = p„, when it is equal to 1 (see Lemma 5.7(ii)). 
Putting this information together, the assertion follows. □ 

Consequently, specializing (xi) to the Chern roots (r^) of the tautological subbundle 
on LGn{V) we have 

Theorem 5.10. The element QiR^ has a nonzero image under tt^, : A*{LGnV) 
A*{X) only if each number p, 1 ^ p ^n, appears as a part of I with an odd multiplicity 
rUp. If the latter condition holds then 

n 

7r.QiR^ = ll{{-irc,pVY'^^-'^^'. 

Proof. This follows from Proposition 5.9 and the equality C2pV = (— l)^ep(rf , r^). □ 

Our next goal will be to show how to compute the images via tt* of S'-polynomials 
in the Chern classes of the tautological Lagrangian bundle. To this end we record the 
following identity of symmetric polynomials. We have found this simple and remarkable 
identity during our work on isotropic Gysin maps and have not seen it in the literature. 
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Proposition 5.11. For every partition I = (ii, . . . and any positive integer p, one 
has in SV{Xn), 

Si{x{,... ,X^) • S(p-i)p„_i(Xn) = ■Sp/+(p-l)p„_i(^n)- 

Here, given a partition I = (11,12, ■■ ■ ), we write pi = {pii,pi2, . . .). 

Proof. We use the Jacobi presentation of a Schur polynomial as a ratio of two alternants 
(see [Mcdl], [L-Sl]). We have: 

si{xi, ■ ■ ■ , xf^j — 



Det{ 



X 



pii + (n-l){p-l) + (n-l) 
k 



<k.l<r 



Det{xl-'), 



j('^(p-i)("-0 + (i-0') 
Det(x?-'-) 



^ gpJ+(p-l)p„-l(-^n) ^ 
S(p-l)p„_i(-^n) 

Corollary 5.12. For p — 2 we get 

Si{xl,... ,xl) ■ Sp^_^{Xn) = S27+p„_i(X^). 

(For another derivation of this identity with the help of Quaternionic Grassmannians see 
Appendix A.) 

We now give a geometric translation of the latter formula, or rather its consequence 

(*) Si{xl,... ,xl)-Sp^{Xn) = Sp^+2l{Xn). 

Theorem 5.13. The element sjR^ has a nonzero image under tt* only if the partition 
I is of the form 2 J + p„ for some partition J. If I = 2J + pn then 

TT^SlK — Sj V , 

where the right hand side is defined as follows: if sj = P{e.) is a unique presentation of 
sj as a polynomial in the elementary symmetric functions ei, E — a vector bundle, then 
s^j\e) := P with Bi replaced by (-l)*C2i-E (i = 1,2, . . .). 

Proof. Since s/i?^ = a;*(q'^"'"''""^) where q = {qi, ■ ■ ■ ,qn) are the Chern roots of Py 
(this is a familiar Jacobi-Trudi formula restated using the Gysin map for the flag bundle 
- see, e.g., [P3] and the references therein), we infer from Corollary 5.6(i) that sjR^ 
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has a nonzero image under tt* only if all parts of / + Pn-i are odd. This implies that 
= n and / is strict thus of the form /' + pn for some partition Finally all parts 
of /' + Pn + Pn—i are odd iff /' — 2 J for some partition J, as required. 

Assume now that I = 2J + and specialize the identity (*) by replacing the variables 
(xj) by the Chern roots (qi). The claimed formula now follows since: si{qf,... , g^) is 
a scalar w.r.t. tt*, 7r*Sp^(gi, . . . , g^) = 1 by Lemma 5.7(ii) combined with Lemma 5.4; 
finally (— l)*C2iF = ei{qj,. . . , g^) because of Lemma 1.1(2). □ 

Observe that the theorem contains an explicit calculation of the ratio in Corollary 
5.6(ii). 

We now pass to the odd orthogonal case. The Weyl group of type Bn- is iso- 
morphic to Sji K Z2 and its elements are "barred-permutations". We use the following 
system of generators of W^: S — {so = (1,2,... ,n), si,... , Sn-i] corresponding 
to the basis (—£1), £1 — £2, £2 — £3, £n-i — £n- Consequently, the divided differences 
di, i = 1, . . . ,n — 1, are the same but do{f) = (/ — sof)/{—xi). 

The odd orthogonal analog of Proposition 5.5 reads: 

i<j wew„ 

Arguing essentially as in the proof of Proposition 5.8 (with obvious modifications), one 
shows that the Gysin map associated with tt : OGnV — > X is induced by the orthogonal 
divided difference operator d(--—r j-.. 

The odd orthogonal analog of Theorem 5.10 reads: 

Theorem 5.14. The element QiR^ has a nonzero image under tt* : A* (OGnV) 
A* (X) only if each number p, 1 ^ p ^ n, appears as a part of I with an odd multiplicity 
rup . If the latter condition holds then 

TT.QiBy = 2^f[{{-irc2pvY^'-'^^^. 

This holds because the calculation in Proposition 5.9 now goes as follows: with the 
notation from the proof of Proposition 5.9, the polynomial 

Qjix:i) = 2-Qj,j,iX^) ... Qj„j,iX^)PpAx:) 
is mapped via S^-^,... j) to 

I 

since d^-:^^ j-^[^Pp^[X^)^ = 1. (The proof of the last statement is the same as that 
of Lemma 5.7(ii).) 

Finally, the odd orthogonal analog of Theorem 5.13 reads: 
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Theorem 5.15. The element sjR^ has a nonzero image under it ^ only if the partition 
I is of the form 2 J + pn for some partition J. If I = 2J + pn then 

[21 

where Sj {—) is defined as in Theorem 5.13. 

This holds because Sp^{X^) is congruent to 2'^Pp^{X^) modulo J (Lemma 5.4) and 
TT^Pp^Ey = 1. Also, we use Lemma 1.1(2). 

We now pass to the even orthogonal case. 

In type Dn the Weyl group Wn is identified with the subgroup of the group of "barred 
permutations" (t^i, . . . , Wn) whose elements have even number of bars only. Consider a 
system 5" of generators of Wn consisting of sj = (2, 1, 3, ... , n) and = (1, 2, . . . , i — 
1, i + 1, i, i + 2, . . . , n), i = 1, 2, . . . , n — 1. {Wm S) is a Coxeter system of type and 
the length function w.r.t. S is 

n 

where ai = card{p \ p > i Sz Wp < Wi} and bj = card{p \ p < j Sz Wp < Wj}. The 
longest element wq in Wn is equal to (1, n) if n is even and to (1, 2, n) if n is odd. 
Following [B-G-G] and [Dl,2] one defines the operators dyj : Z[Xn] — > for w G Wn 

( here, 

dif = (/ - f{-X2, -3^1,3^3, ...,Xn))/{-Xi - X2). ) 

The even orthogonal analog of Proposition 5.5 reads: 

i<j weWn 

The even orthogonal analog of Corollary 5.6 reads: 

Lemma 5.16. (i) dw^{xi^X2^ . . . x^") = if ap is odd for some p = 1, . . . ,n. 
(a) If all ap are even then 

= {-ir^''-'^/'2--'sp^_AXn)-'d{Xa), 

where d denotes the Jacobi symmetrizer. 

Proof, (i) Let us fix cr e Sn and look at all elements of W^ of the form (o", r) where 
T e {+1, -1}'' and Yl- Ti = 1. We have 

J](-l)'('^'-) (a, r)x- = (-l)'(-)a(x«) J2 ■ ■ ■ , 
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because l{a, r) = l{a) {mod 2). Suppose that some numbers among cti, ... , are odd. 
We can assume that cti, . . . ,ak are odd and ak+i, ... , ctn are even for some k < n (by 
permuting the Tp's if necessary). We have 

^^ai _ _ _^an _ y^^(^_iyard{p\ Tp = -1, p>k} _ 2^ | J = Q. 

T T 1=0 V ^ / 

(ii) Let us now compute 5u,^(a;i^ . . .a;^") where all ctp are even. Then 

^rf^ =2'^-\ and 

T 

^ (-l)-(--i)/22-isp„_,(X,)-ia(a;«). □ 



Let us now denote by J the ideal in SV{Xn) (g) Z[l/2] generated by ei(xf, . . . 
z = — 1, and xi ■ . . . ■ Xn- In the following analog of Lemma 5.4 we write 

ei = ei{Xn), si = si{Xn), Pi = Pi{Xn) and Pi = Pi{Xn) for brevity. 

Lemma 5.17. In SV{Xn) ® Z[l/2], 

= 2-(--i)e„_ie„_2 . . .ei = 2-(--i)s^„_, (mod J). 

Proof. Proposition 5.2 implies that Pp^. = Det{aij)i^ij^<^k where a^j = Pfc_(_i+j_2i if 
k + l+j-2iy^0 (with Pj = for i < 0) and Pij = 1 if k + l+j -2i = 0. Similarly as in 
Corollary 5.3, this implies that in SV{Xn) ®Z[l/2], Pp^ is congruent to Det{bij)i^ij^k 
modulo J, where bij = Pk+i+j-2i ii k+l+j — 2i^0 ( with Pj = for z < 0) and 
bij = 1 if A; + 1 + J — 2z = 0. Thus it is sufficient to prove that Det{2bij)i^ij^n-i = 
Cn-i-.-ei = Sp^_^ (mod J). Recall that = Det{ci^j)i^ij<^n-i where = 

e„-|-i_|_j_2i if n + 1 + J — 2i and = 1 if n + 1 + j — 2i = 0, i.e. the matrices {2bij) 
and {cij) are the same modulo the degree entries. 

Let us write the determinants Det{2bij) and Det{cij) as the sums of the standard 
n\ terms (some of them are zero). It is easy to see that apart from the "diagonal" term 
Cn-i •••61, every other term appearing in both the sums is divisible either by or by 
e„_ien-2 • • • Cp+iCp for some p ^ 1. We claim that, e„_ien-2 • • • Cp+ie^ G JT". To this 
end, it suffices to show that e^_i belongs to J' and argue as in the proof of Lemma 5.4. 
The needed claim follows from the fact that e^_i — en-i(a;f , ... , x^) is divisible by e^. 

This shows that 

Det{2bij) = Cn-i . . .ei = Det{cij) {mod J). 
Thus the lemma is proved. □ 

The even orthogonal analog of Lemma 5.7 for the operator V = ^2,1) if is even 
and V = 2,1) if ^ is odd, reads as follows. 
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Lemma 5.18. (t) If f e SVixj, . . . ,xl)[xi ■ . . . ■ x„] then S7{f ■ g) = f ■ v{g). 

^u; v(Pp„_,(x.)) = (-ir(-i)/^ 

Proof, (i) This assertion is clear because every polynomial in SV{xl, . . . , x'^)[xi • . . . • Xn] 
is Wn-invariant. 

(ii) In this part we will use the Jacobi symmetrizer d (see the proof of Lemma 5.7). In 
the following, I = JZ[Xn]. 

Let = ei{Xn). Since Pp^_^{Xn) = 2~^'^~^^ Cn-i . . .ei (mod X), we have 

V(P^„_, {Xn)) = V(2-("-i)e,_i . . . ei) = (V o d){2-^^-^^ x^-' Cn-i • • • ei) 
= a„„(2-("-i)a;^"-en-i...ei). 

The degree of the polynomial x^^-'^en-i . . . ei is — n. Assuming that cii + + = 
■n? — n, we have d^^ (x") ^ only if 

™a _ „2n-2 2n-4 2 

~ "^(tCI) *^a(2) • • • •^a(n-l)'^a(n) 

for some a G 5',^. Indeed, it follows from Lemma 5.16 that dwo{x'^) 7^ only if all the a^'s 
are even. Moreover, they must be all different; otherwise d{x") = and consequently 
dwoi^"") = 0- We conclude that {ai, . . . , q;„} = {2n — 2, 2n — 4, . . . ,2, 0}. But there is 
only one such a monomial x'^ in a;^"-ie„_i . . . ei, namely the one with {ai, . . . , a^) = 
(2n - 2, 2n - 4, . . . , 2, 0). Therefore 

d^,{2-(^-'^xP-^en-i . . .ei) = 2-("-i)<(x^-2x2-4 . ..xl_,x'J = 

by Lemma 5.16. □ 

The even orthogonal analog of Proposition 5.9 reads (since e^(X^) is a scalar for V, 
it suffices to evaluate the images via V of Pj(X^), where alHp ^ n — 1): 

Proposition 5.19. Let I be a partition with all parts not greater than n — 1. One has 
y{Qi{X^)) ^ only if the set of parts of I is equal to {1, 2, . . . , n — 1} and each number 
p (l^p^n — 1) appears in I with an odd multiplicity rup. Then, the following equality 
holds in Z[X„], 

n-1 

v{Qr{X:)) =2-'l[ep{xl... ,x'J-^^-'y'. 

p=i 

Arguing as in the proof of Proposition 5.8 one shows that the Gysin maps tt^ associated 
with TT : OG'^V — > X (resp. tt : OG'^V — > X) are induced by the operator V. The role of 
LFliy) is played now by the flag bundle parametrizing flags of rank 1, rank 2, rank n 
isotropic subbundles of V whose rank n subbundle E satisfles dim{Er\Vn)x = n {mod 2) 
(resp. dim{E n Vn)x = n + 1 {mod 2)) for every x E X. Consequently, the proposition 
whose proof is the same as the one of Proposition 5.9, has as its consequence: 
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Theorem 5.20. Let I be a partition with all parts not greater than n — 1. The element 
QiBy has a nonzero image under tt* only if each number p, 1 ^ p ^ n — 1, appears as 
a part of I with an odd multiplicity rup. If the latter condition holds then 

~ . / \ (mp-l)/2 

Theorem 5.21. The element siR"^ (/(/) ^ n — 1) has a nonzero image under tt* only 
if the partition I is of the form 2J + pn-i for some partition J {1{J) ^ n — 1). If 
I — 2J + Pn-i, then 

[21 

where S j {—) is defined as in Theorem 5.13. 

Proof. Since siR^ = uj^{q^~^''^-^) where q = (qi, . . . ,qn) are the Chern roots of i?^, 
we infer from Lemma 5.16 that s/i?^ has a nonzero image under tt* only if aU parts of 
I + Pn-i are even. This implies that 1{I) = n — 1 and / is strict thus of the form I' + pn-i 
for some partition Finally all parts of /' + Pn-i + Pn-i are even iff /' = 2J for some 
partition J, as required. 

Assume now that I = 2J + Pn-i and specialize the identity from Corollary 5.12 by 
replacing the variables (xi) by the Chern roots (qi). The claimed formula now follows 
since: Si{qf,... ,q'^) is a scalar w.r.t. tt*, 7r*Sp^_^ (qi, . . . , g„) = 2'^~^ by Lemma 5.17 
and 5.18; moreover 2{—iyc2iV = 2ej(g^, . . . , q'^) by Lemma 1.1(2). □ 

Remark 5.22. 1. Our desingularizations of Schubert subschemes are compositions of 
flag- and isotropic Grassmannian bundles (see Section 1). Therefore Corollary 2.6, the 
algebra of Q-polynomials together with formulas for Gysin push forwards (Theorem 5.10 
for Lagrangian Grassmannians and a well known formula for projective bundles) give 
an explicit algorithm for calculation the fundamental classes of Schubert subschemes in 
the Lagrangian Grassmannian bundles. One has analogous algorithms in the orthogonal 
cases. Examples of such calculations are given in Section 6 and 7. 

2. In case X is singular, by interpreting polynomials in Chern classes as operators 
acting on Chow groups (see [F]) or singular homology groups, the same formulas hold 
(after their obvious adaptation to the operator setup). 

We finish this section with the following important "orthogonality" property for the 
Gysin maps associated with isotropic Grassmannian bundles. 

Theorem 5.23. (i) For n : LGnV — > X and any strict partitions I, J (c pn), 

TT^iQiR'' ■QjBy) = 5i,p^^j. 
(a) For TT : OGnV — > X (dimV = 2n+ 1) and any strict partitions I, J (c pn), 
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(in) ForTT : OG'^V — > X (resp. OG'^V X), and any strict partitions I , J (c Pn-i), 

(Here, 5.,. is the Kronecker delta.) 

Proof. We will prove first the Lagrangian case (i). (In case (ii), the proof goes mutatis 
mutandis using the divided differences operator ^(tjT^ j) for S0{2n+ 1) instead of 
the operator V for Sp{2n) . Case (iii) will be discussed separately at the end of the proof. 

Let Xn = {xi, ...,Xn) be a sequence of variables. We show that the operator V : 
Ij[Xn\ '^[Xn], satisfies the following formula for any strict partitions /, J (c pn)'- 

y{Ql{X^n)-Qj{K))-5l,Pr.^J- 

Since TT* is induced by V (Proposition 5.8), this implies the assertion. Observe that for 
the degree reasons V{Qi ■ Qj) — for |/| + \ J\ < n{n + l)/2 (here and in the rest of the 
proof, Qi = Qi{X^)). Also, because of the universality of the formula for tt* (see e.g. 
Theorem 5.10), we know (Lemma 2.3, Lemma 2.4 and 5.8) that for |/| + | J| = n{n + l)/2, 
^{Qi • Qj) — unless J = pn ^ I , when V{Qi ■ Qj) — 1. So it remains to show that 
for |/| + I J| > n{n + l)/2, V(Q/ ■ Qj) — 0. The proof is by double induction whose first 
parameter is and the second one is ii where I = 1{I) (i.e. the shortest part of /). 

Assume first that / = (i) and use the Pieri-type formula from Proposition 4.9. A 
general partition J' indexing the R.H.S. of the formula from Proposition 4.9 stems from 
J by adding a horizontal strip of length i. Since | J| +z > n(n+ l)/2, the only possibility 
for getting V((5j') 7^ is the following (Theorem 5.10): there exist two equal parts p in 
J' such that after factoring out Qp^p from Qji (Proposition 4.3) we obtain (5p„ (recall 
that Qp^p is a scalar w.r.t. V). But 1{J') < 1{J) + 1 < n + 1, so after factoring out the 
length of the so-obtained partition is not greater than n — 1, i.e. this partition is not pn- 

To perform the induction step write /' = (zi, z/_i) and r = ii where we assume 
that I = 1{I) > 2. Using the Pieri-type formula again, we have: 

Qi-Qj = (Q/'-Qr)-Qj-($^2-(^''''''^^QM)-Qj = Qi'-{Qj-Qr)-{Y.2^^''^--^^^QM)-Qj 

M M 

= Qr ■ (J]2-(-^'^;^)QAr) - (J] 2-(^>'^)Qm) • Qj. 

N M 

Here M runs over all partitions different from / which contain /' with M/I' being 
a horizontal strip of length r. Observe that either 1{M) < /(/) or 1{M) = /(/) but 
nil < ii = so we can apply the induction assumption to M . The partitions M and N 
can have equal parts; if so, using the factorization property, we write: 

Qm = Qpi,pi • . . . • Qps,Ps ' Qmi and Qn — Qqi,qi • . . . • Qqt,qt " Qni, 
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where Mi, A^i are strict partitions and pi > . . . > Ps, qi > . . . > Qt are positive integers. 
Using the induction assumption or because of the degree reasons we see that the only- 
possibility to get in the first sum a summand (corresponding to N) which is not anihilated 
by V is: after adding to J a horizontal strip of length r and factoring out all pairs of 
equal rows, we obtain the partition A^i = \ /'. Similarly, the only possibility to get in 
the second sum a summand (corresponding to M) which is not anihilated by V is: after 
adding to /' a horizontal strip of length r and factoring out all pairs of equal rows, we 
obtain the partition Mi = \ J . 

Therefore to conclude the proof it is sufficient to define, for a fixed pair of strict 
partitions J and fixed positive integers r and p. : pi > . . . > ps, a bijection between 
the sets of partitions (with parts not exceeding n): 

jV = { N \ N D J; N/J is a horizontal strip of length r; N has exactly s parts occuring 
twice, equal to p.; after subtraction from N the parts p. one obtains pn I'} 

and 

M. = { M I M D M/I' is a horizontal strip of length r; M has exactly s parts occuring 
twice, equal to p.; after subtraction from M the parts p. one obtains pn \ J} 

which preserves the cardinality of the connected components of the strip, not meeting 
the first column (compare the Fieri- type formula used). 

In order to define the bijection $ : — > Al we first invoke the diagramatic pre- 
sentation of the ^^-complementary partition from [P2, p. 160]: for example n = 9, 
/=(9,6,3,2),p9\/ = (8,7,5,4,l). 



• • • • 

o • • • • 

o o o o • • 

Fig.l o o o o o • • 

ooooooo* 
oooooooo* 

(the collection of "•" gives the shifted diagram of / (appropriately placed); the collection 
of "o" gives the shifted diagram of pg \ /). The map ^ : ^ M. is defined as 
follows. Having an element N e jV, i.e. a strict partition J with an added horizontal 
strip of length r, e.g. J = (9,6,3,2),r = 5,N = (9, 8, 3, 3, 2), s = l,p. : 3 (and 
/'= (7,6,5,4,3,1)): 



Fig.2 



® ® 
• • ® 

9 9 9 



® ® 
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we remove the s bottom rows in all pairs of equal rows (in the example, the third row) 
and place the shift of the so-obtained diagram as in Fig.l to get the diagram N, say. In 
our example we get the diagram in Fig. 3 : 



Fig.3 



Fig.4 



o ® ® 

o o o o 

o o o o o 

o o o o o o 

o o o o o o o 



(We know, by the definition of jV, that if we would also remove from N the remaining 
parts of lengths p. then the resulting partition will be p„ \ We preserve these parts, 
however, because we need them for the construction of $(A^).) Then we construct the 
complement of the so-obtained diagram in p^- In our example, using "o" to visualize 
the complementary diagram we get the diagram in Fig.4. By reshifting the so-obtained 
complementary diagram plus the same horizontal strip (now added to this complementary 
diagram) - call it ^{N)q, and inserting s rows of lengths p., we get the needed partition 
^{N). Observe that : 

1) Since at the last stage we have inserted rows of lengths p., ^{N) consists of the 
diagram /' with an added horizontal strip of length r. 

2) ^{N) has exactly s parts occuring twice, equal to p. (apart from the parts inserted at 
the last stage, the remaining s parts are the rows whose the rightmost boxes are precisely 
the lowest boxes of the rows of length p. in N). 

3) After removing from ^(N) the 2s parts equal to p., we get \ J (this is the same 
as removing from ^{N)^ the s parts equal to p. - but ^{N)q minus s parts equal to p. 
complements precisely J in pn). 

Therefore $(A^) G Ai. Also, the cardinality of the connected components of the strip 
not meeting the first column is preserved by $. In our example, we obtain 



Fig.5 



o ® ® 

o o o 

o o o o 

o o o o o 

O O O O O O (§) 

o o o o o o o 



i.e. $(iV) = (8,7,5,4,3,3,1). 

Let us now define, by reversing the roles of J and /', the map \I/ : 7W — > J\f. If we 
define, by a complete analogy to the above, the partitions M and \E'(M)o, then we have 
N = *(M)o and $(iV)o = M; and clearly * o $ = idj^ and $ o ^' = idM- 
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This proves the orthogonahty theorem in the Lagrangian case. 

Essentially the same proof, with Q-polynomials replaced by P-polynomials (for which 
a Fieri- type formula is given below), works in the odd orthogonal case (ii). 

In the even orthogonal case the proof goes as follows. Let V : — > be the 

even orthogonal divided differences operator inducing n^. 

We show that the operator V : Z[Xn] satisfies the following formula for any 

strict partitions /, J (c Pn-i)'- 

Since tt* is induced by V, this implies the assertion. Observe that for the degree reasons 
y{Pi-Pj) = Ofor |/| + |J| < n(n- 1)/2 (here and in the rest of the proof, Pj = Pi{X^)). 
Also, because of the universality of the formula for tt* that for |/| + \J\ = n{n — l)/2, 
V(P/ • Pj) = unless J = Pn-i \ I, when V(P/ • Pj) = 1. So it remains to show that 
for |/| + I J| > n{n — l)/2, V{Pi ■ Pj) = 0. The proof is by double induction whose first 
parameter is and the second one is z/ where I = 1{I) (i.e. the shortest part of /). 

Assume first that / = {%) and use the Pieri-type formula for P-polynomials (see 
Proposition 4.9; a Pieri-type formula for P-polynomials reads similarly: 

Pj-Pi = ^2'"'('^'^=-^')Pj,, 

the only difference being the exponent m'{J,i; J') equal to m{J,i; J') if J'/ J meets the 
first column and m( J, i; J') — 1 - if not.) 

A general partition J' indexing the R.H.S. of the Fieri formula stems from J by adding 
a horizontal strip of length i. Since | J| + i > n(n — l)/2, the only possibility for getting 
V(Pj/) 7^ is the following: there exists a (single) row of length n or there exist two 
equal parts p in J' (1 ^ p ^ n — 1) such that after factoring out P^ and Pp p from Pj/ 
(Proposition 4.3) we obtain Pp^_^. As in the proof of the Lagrangian case we see that it 
is impossible to get Pp^_^ after factoring out Pp,p. Also, it is impossible to get Pp^_^ by 
factoring out P^. Indeed, using the Pieri-type formula, we should add one box to each 
of the first n columns which is impossible because i — 

To perform the induction step write /' = (ii, i^-i) and r = ii where we assume 
that I = > 2. Using the Pieri-type formula, we have: 

Pi.Pj = Pp . (^2'"'(-^''-'^)PAr) - (5^2"^'(^''^'^)Pm) • Pj. 

JV M 

Here M runs over all partitions different from / which contain /' with M/I' being 
a horizontal strip of length r. Observe that either 1{M) < /(/) or /(M) = /(/) but 
nil < ii = r, so we can apply the induction assumption to M. The partitions M and N 
can have equal parts; if so, using the factorization property, we write: 

Pm = Ppi,pi • • • • • Pps,Ps ■ Pmi and Pjv = Pqi,qi • • • • • Pqt,qt ' Pnh 
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where Mi, A^i are strict partitions and pi > . . . > Ps, qi > . . . > Qt are positive integers. 
Moreover M and N can contain a single row of length n, and if so, then the polynomial 
Pn can be factored out by a property of the operator V. Using the induction assumption 
or because of the degree reasons we see that the only possibility to get in the first sum 
a summand (corresponding to N) which is not anihilated by V is: after adding to J a 
horizontal strip of length r and factoring out all pairs of equal rows and the row of length 
n (if any), we obtain the partition A^i = Pn-i \ I'- Similarly, the only possibility to get 
in the second sum a summand (corresponding to M) which is not anihilated by V is: 
after adding to /' a horizontal strip of length r and factoring out all pairs of equal rows 
and the row of length n, if any, we obtain the partition Mi — Pn-i \ J- 

Therefore to conclude the proof it is sufficient to give two bijections. 

The data of the first bijection are: a pair of strict partitions J C Pn-i and fixed 
positive integers r and p. : pi > ... > Ps- One needs a bijection between the sets of 
partitions (with parts not exceeding n — 1): 

A/" = { N \ N D J; N/ J is a horizontal strip of length r; has exactly s parts occuring 
twice, equal to p.; after subtraction from N the parts p. one obtains Pn-i ^ I'} 

and 

^ = I M I M D M/I' is a horizontal strip of length r; M has exactly s parts occuring 
twice, equal to p.; after subtraction from M the parts p. one obtains Pn-i "\ J} 

which preserves the property that the strip meets or not the first column and preserves 
the cardinality of the connected components of the strip, not meeting the first column - 
compare the Fieri- type formula used). 

Here the bijection $ : A/" — > from the proof of the Lagrangian case with n replaced 
by n — 1 does the job (i.e. to construct $(A^)o for N E we take the complement in 
Pn-i)- Note that $ preserves the property that the strip meets or not the first column 
by the construction. 

The data of the second bijection are also: a pair of strict partitions J C Pn-i and 
fixed positive integers r and p. : pi > . . . > ps- One needs a bijection between the sets 
of partitions (with parts not exceeding n): 

M' = { I D J; N/ J is a horizontal strip of length r; N has a single part equal to 
n; has exactly s parts occuring twice, equal to p.; after subtraction from N 
the parts p. and n one obtains Pn-i \ -f'} 

and 

AA' = { M I M D /'; M/I' is a horizontal strip of length r; M has a single part equal to 
n; M has exactly s parts occuring twice, equal to p.\ after subtraction from M 
the parts p. and n one obtains Pn-i \ 

which preserves the property that the strip meets or not the first column and preserves 
cardinality of the connected components of the strip, not meeting the first column. 

Here we also use the map $ from the proof of case (i) (to construct ^{N)q for N e J\f' 
we take the complement in p^). We ilustratc the map $ on the following example. 

Let n = 10 , J = (8, 7,4,2), N ^ (10, 8, 4, 4, 2) and /' = (9, 7, 6, 5, 4, 3, 1) . 
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(N = {10, 8, 4, 4, 2}) X {10, 4, 4} = {9, 8, 7, 6, 5, 4, 3, 2, 1} \ ({9, 7, 6, 5, 4, 3, 1} = /') 

($(iV) = {10, 9, 6, 5, 4, 4, 3, 1}) \ {10, 4, 4} = {9, 8, 7, 6, 5, 4, 3, 2, 1} \ ({8, 7, 4, 2} = J) 

We have $(A/'') C M'. Indeed, if iV G A/"' then $(7V) has a part equal to n by the 
construction. Moreover, the equations: 

N \ {n,p.} = pn-i \ /' , ^N) \ {n,p.} = pn-i \ J 

are equivalent to the equations: 

N X {p.} = Pn \ /' , HN) \ {p.} = pn \ J, 

SO the assertion follows from the proof in case (i) above. 

By reversing the roles of J and one defines (as in the proof of case (i)) the map 
* : M' W which satisfies: o $ = id^^i and $ o ^' = idM'- 
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This ends the proof of the theorem. □ 

6. Single Schubert condition 

We consider first the Lagrangian case G = LGnV and follow the notation introduced 
in Section 1. 

Proposition 6.1. The class of Q{a) in A*{G), where a = n + 1 — i, is given by the 
formula 

i 

Proof. The desingularization oi Q{a) C G is given by the composition (recall that 
Fl{a.) from Section 1 is here P(Fa) and C is the tautological line bundle on it): 

^ = LGn-l{C^/C) ^ ¥{Va) ^ G , 

where tti and it2 denote the corresponding projection maps. By Corollary 2.6 we have 

(*) [z]= E Q/^^ • 

strict iGpn 

Let S be the tautological rank n — 1 bundle on J^; S = D/Cj^. Let c = ci(C^). Then, 
by Proposition 4.1, 

n 

(**) QjD^ = J2i^lc)'^-Y.^J^^ ' 

fc=0 J 

the sum over all partitions J C / of weight \J\ = \I\ — k and I/J has at most one 
box in each row. By Theorem 5.10 the only /'s in (*) for which (7ri)*(5/D^ 0, 
are those containing Pn-i, i-e. / must be equal to one of the partitions of the form 
Ip = {n,n — 1, . . . , p + 1, p — 1, . . . , l) for some p = 0, 1, . . . ,n. For I = Ip the only term 
in (**) which contributes after applying (tti)* is the one with J = pn-i and k = n — p. 
Since, by a well-known push forward formula for projective bundles, we have 

we infer that only p = 0, 1, . . . ,i give a nontrivial contribution from (**) (with k = n—p). 
Finally, we get 

i i 
p=0 p=0 

as asserted. □ 

Essentially the same computation gives the following formula in for G = OGnV where 
dim V — 2n + 1 . 
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Proposition 6.2. The class of Vt{a) in A*{G) , where a = n+ l — iis given by the 
formula 

Ma)] =1/2. tcpEys,_^m.^ 

Consider finally the even orthogonal case where the computation is slightly different. 

Proposition 6.3. The class ofQ{a) in A*{OG'^V) for odd n, or in A*{OG'ly) for even 
n, is given by the following expression where i = n — a: 

i 

[Q{a)] = 1/2 ■ J](cpi?^ + CpVn) Si-p{V^). 

Proof. Suppose that n is odd. Then the desingularization of ri(a) C G = OG'^V is 
given by the composition: 

^' = OG'^_^iC^/C) ^ ¥{Va) ^ G , 

where tti and 7r2 denote the corresponding projection maps. 

If n is even then the desingularization J^" of Q{a) G G = OG'/^V is given by the 
composition: 

JF" = OG';_^iC^/C) ^ P(K) ^ G , 

where tti and it2 denote the corresponding projections. In the following we denote by 
both J^' and J^" for brevity. 

By Proposition 2.7 we have in both the cases: 

[Z]= Yl PiD^ ■ Pp.-.^iR'' ■ 

strict I<Zpn-i 

Let S be the tautological rank n—1 bundle on .F; S = D/Cj^. Let c = ciC^. Then, by 
Proposition 4.1 interpreted now in terms of P-polynomials we have 

n 

(***) PiD-" = ^«c)'= • (J2 2^(-^>-^«Pj5^) , 

the sum over all partitions J C / of weight | J| = |/| — k and I/J has at most one box 
in each row. By Theorem 5.20, if (7ri)*Q/D^ ^ then / D Pn-2i so / must be equal 

^Observe that though "1/2" appears in the formula, the integrality property of the class obtained 
holds true (i.e. we get the class in the Chow group with the integer coefficients). This follows directly 
from our way of computing it. Indeed, the (odd) Orthogonal version of Proposition 2.5 and consequently 
also of Corollary 2.6 holds true over integers. Also, the integrality is preserved by the Gysin maps in 
the odd Orthogonal analogs of Propositions 3.1 and 3.2. The same remark applies to Proposition 6.3 
and Theorem 7.9 below. 
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to the partition Ip — (n — 1, n — 2, . . . ,p + l,p — 1, . . . , l) for some p = 0,1, . . . ,n — 1. 
More precisely, the only terms in (***) which contribute nontrivially after applying (tti)* 
correspond to the following two instances: 

(1) I = Iq = Pn-i, k = and J = Pn-i - this gives a difference between the odd 
orthogonal case and the present one. 

(2) I = Ip, k = n — p — 1 and J = Pn-2', here p = 0,1, . . . ,n — 1 but we will see that 
only p = 0,1, . . . ,i give a nontrivial contribution. 

Let us first compute the contribution of (1). We claim that 

(7ri).Pp„_,5^ = l/2-^, 

where v = c^_i(T^/C). Indeed, if n is odd then 

(7ri).Pp„_,-5^ = 1/2 • (TTi). (c„_i5 • Pp„_,-S^) = 1/2 • (TTi). • = 1/2 • ^ 

by Lemma 5.18 and a theorem of Edidin-Graham [E-G] asserting, in this case, the 
equality Cn-iS = v. 

If n is even then 

(7ri).Pp„_,-S^ = -1/2 • {m).{cn-iS ■ Pp„_,5^) = -1/2 • (7ri).(-^ • Pp„_,5^) = 1/2 • ^ 

because the theorem of Edidin-Graham now asserts that Cn-iS = —v. 
Therefore the contribution of (1) is equal to 

(7r2 O 7ri).Pp„_,5^ = 1/2 • (7r2)*Cn-l(K/C) 

n-l 

= 1/2 • {7T2%CE{-^r~''~'cpVn ■ Sn-p-lC) 
p=0 

n—1 n—1 
= 1/2 . (tTs), CpVn ■ C^-P-') = 1/2 • C,Vn ■ S,_pC^) 

p=0 p=0 

On the other hand the contribution of (2) is equal to 
l/2-(7r207ri),(cpi?^-c--^'-i-Pp„_,5^) = l/2-Cpi?^-(7r2).(c"-^'-i) = l/2-Cpi?^-s,_p(V/). 
Summing up the contributions of (1) and (2) we infer 

i 

[n{a)] = 1/2 • J](cpFn + CpR'') ■ Si-p{V^), 
which is the asserted formula. □ 
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7. Two Schubert conditions 

In this section we treat the classes of Schubert subschemes defined by two Schubert 
conditions in the Lagrangian and odd orthogonal cases. 

We consider first the Lagrangian case. Our desingularization of Q{n + l — i, n+l—j) in 
G = LGnV is given by the composition (we use the notation of Section 1, rank C = 2): 

7 = LGn_2{C^/C) ^ Fl{Va C n) ^ G, 

where (a, 6) = (n + 1 — z, n + 1 — j) and the element to be push forwarded via (7r27ri)* 
is ^(5/-D^ • (5p„\7-R^, the sum over all strict / C Pn- Let S be the tautological rank 
(n - 2) bundle on LGn-2{C^/C). Using [D^] = [5^] + [C^] and the linearity formula 
from Proposition 4.1 together with the factorization property from Proposition 4.3, we 
have {'Ki)^QiD^ ^ only if (7ri)*QjS'^ 7^ for some J C /. By virtue of Theorem 5.10 
(applied to S^), (7ri)*QjS'^ ^ only if J D Pn-2- Consequently, the unique strict /'s 
for which (t:i)^QiD^ ^ must contain Pn-2, i-e. they are of the form: / = p^, / = 
(n,n - 1,... ,p, ... ,1) =: /p, / = (n,n- 1,... ,p, ... ,g, ... ,1) =: (here, p and q 
run over {1, . . . ,n} and the symbol " " " indicates the corresponding omission). 

We need the following technical lemma. 

Lemma 7.1. If rank C = 2 then 

(li) Forq<p, Qi^jp^_^{C'')=Sn-q-l,n-p{C'^)\ 

(in) ForO^v^n-2, Q^^/(^_^^(2)«r(C"') = Sn-.,n-.-i(C^). 

Proof. The proof is an easy application of the linearity formula from Proposition 4.1 and 
is given here in case (i) (the proofs of (ii) and (iii) being similar). 

Denote the Chern roots of by xi,X2. Consider the skew Ferrers' diagram of 
Ip/ Pn-2 and fill up with "1" the boxes, whose subtraction correspond to the summands 
in Proposition 4.1 applied to xi instead of x^- Then fill up with "2" the boxes, whose 
subtraction correspond to the summands in Proposition 4.1 applied to X2 instead of Xn- 
Of course it is impossible to have two "1" or two "2" in one row. Also, the following 
configuration cannot appear: 

2 

X 1 

where the box "x" belongs to -Dp„_2 (Having two equal rows ending with ^ we use 
Proposition 4.3, thus we must subtract both boxes instead of the higher one only). For 
example, for n = 6, p = 3 we get two Ferrers' diagrams, one contained in another 
(depicted with "•" and "x"): 
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• 

X • 

X X • • 

X X X • • 

X X X X • • 

and we have 3 possibilities: 



2 1 1 

2 2 1 

2 1 2 1 2 1 

2 1 2 1 2 1 

2 1 2 1 2 1 



giving Q/3/p4(x 1,0:2) = {xiX2)'^ixl + X1X2 + xl) = S5^3{xi,X2). In general, arguing in 
the same way, we get 

= e2{xi,X2)"'~^Sp-i{xi,X2) = Sn-l,n-p{xi,X2). □ 



Lemma 7.2. With the above notation we have: 

(ii) For q<p, (7ri)*(Q7^^D^) = s„_q_i,n_p(C^); 



n-2 



(Hi) (7ri),(gp„L>^) = j:{-l)''C2kV- Sn-k,n-k-l{C'')-Sn-k+l,n-k-2{C'') + ... 

k=0 

• ••+(-i)'^-"s2(n-fc-i),i(c^: 

Proof. Assertions (i) and (ii) follow immediately from Lemma 7.1(i),(ii) and Theorem 
5.10. As for (iii), we have ( in the following, (7ri)*( other terms ) — )'■ 

(7ri).(Q,„L»v) = 

rn-2 _ _ 

= (TTi)* E Q(p„_,+(2).r('5'') • ^p„/(p„_.+(2)^r(^^) + (o^^er terms) 

'-v=0 

n-2 _ 
n-2 r -| 

E (-1)" E C2kV ■ S2liC e C^) • Sn-,,n-v-l{C'') 



'-k+l=v 



n — 2 rn — 2 — k 

E(-l)'c2fcV- E {-iyS2l{C®C'')-Sn-k-l,n-k-l-l{C''] 
k=0 1=0 
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n-2 



— (~l)'^C2feV^ • Sn-k,n-k-l{C^) — Sn-k+l,n-k-2{C^) + ■ ■ ■ 
k=0 L 

••• + (-ir-'^2(n-fe-l),l(C^^) 

where the above equahties foUow from: Theorem 5.10, Lemma 1.1 and Pieri's formula 
([Mcdl], [L-Sl]); recaU that rank C = 2. □ 

Lemma 7.3. Let < a < b and k ^ I ^ be integers. Let C be the rank 2 tautological 
(sub)bundle of t : Fl{a, b) —>■ X . Then 

where we assume Sh{—) = for h < 0. 

Proof. Let Ci C C2 = C be the tautofogical subbundles on Fl{a, 6), Ci C 14, C2 C H; 
rank Ch = h, h = 1,2. Let xi = ci{C)[) and X2 = ci((C2/Ci)^). The flag bundle 
r : FZ(a, b) ^ X is equal to the composition: 



We have 



The assertion now follows by applying to all summands the well known formulas: 

(T2)*(a^2) = Sp-(6-2)(V6/Cl)^ = Sp_Q,_2){V^) - Sp_(6_2)-l (H^) ' Xi, 

and simplifying. □ 



Theorem 7.4. For n ^ i > j > one has in A*{G) with a = n + 1 — i, b = n + 1 — j , 



p>q>0 



i-1 



where we assume Sh{—) — for h < 0. 



Proof. It follows from Lemma 7.2 that 
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[fi(a,5)]= E (7r2)*(Sn-,-l,n-p(C^)) + 
0^q<p 

n-2 p 
+ (-l)^C2pF • (772)* Sn-p.n-p-llC'^) " Sn-p+l,n-p-2(C"^) + • • • 

••• + (-l)"-^«2(n-p-l),l(^'') 

Applying Lemma 7.3 to 7r2 : Fl{a, b) X, the assertion follows. □ 
Example 7.5. 1. For i — 2, j — 1 and any n the formula reads: 

= Q2ii?^ + Q2i?^ • QiC + QiR"" ■ + Q2iC- 

2. For i = 3,j = 1 and any n one obtains, with Qp,q = Qp^qR^ , Sk = Sk{V^_2) and 
s'f^ = Sk{V^), the expression: 

Q3I + Qs ■ s'l + Q2I ■ Si + Q2 ■ Si ■ s[ + Qi ■ {S2 ■ s[ - 83) + 

+S2 ■ S2 - S4 - Si ■ s'^ + s'^ - C2V ■ {Si ■ s[ - S2) + C4V. 

3. For i = 3,j = 2 and any n one obtains, with Qp,q = Qp^qR^ and Sk,i = Sk,i{V^_i), 
the expression: 

Qs2 + Q31-Sl+Q3-S2 + Q21-Sll+Q2-S21+Ql-S22 + SS2-S41 + S5-C2V-{s21-Ss) + C4V-Si. 

More generally we have: 

Corollary 7.6. With the above notation and j = i — 1, Sk,i = Sk,i{V^_^2-i)} class 
[fl{a,b)] equals 

^ i—\ i—l—p 

^ Qp,qR^ ■ Si-l-q^i-p + ^ (-l)^C2pV • ^ {-1^ Si-p^h,i-l-p-h- 

Consider now the odd orthogonal case. Our desingularization in case a. — (a, b) := 
(n + 1 — i,n + 1 — j) is given by the composition (rank C = 2): 

OGn-2{C^/C) ^ Fl{Va C Vb) ^ G. 

Then the analog of Lemma 7.1 reads (with the notation explained before this lemma): 
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Lemma 7.7. ; 

^p„/(p„_,+(2)^r(C"') = , < ^ ^ n - 2 , 

Pp„/p„_,(CV) = l/4-.„,,_i(C^). 

The element to be push forwarded via (7r27ri)H< is ^P/D^ ■ Pp^^-^iTf , the sum over 
all strict I (Z Pn (the notation as in Section 1). The analog of Lemma 7.2 reads: 

Lemma 7.8. ; 

(l) {TTiUPl^D'^) = l/2-Sn-l,n-p{C''). (it) q < p {TTiUPi^^^D'') = S„_,_i„(CV). 
~ n-2 

(in) (7ri),(Pp„DV) = 1/4- E (-l)'=C2fc F • [s„_fc,„_fe_i(C^) - s,_fc+i,,_fc_2(C^)+ 

fe=0 

•••(-ir-'-^2(n-fc-l),l(C^^)]- 

Consequently, the analog of Theorem 7.4 now reads: 
Theorem 7.9. For n ^ i > j > one has in A*{G) with a = n + 1 — i, b = n + 1 — j , 

P>g>0 \ / 

1/2 ■EPpR''- (si-pm ■ Sj{V,^) - ..(VV) . s,-,{V,^)) + 

+1/4 • E E (-i)^+'-'c2p F • (si-p-t(K^) • s,-p+t(n^) - • (V)) • 

p=0 t^l ^ ^ 

For instance, invoking Example 7.5, the formula reads for i = 2,j = 1 and any n: 
[Q{n - l,n)] = + P2By ■ P^V^ + ■ ^2^ + ^2iC- 

8. An operator proof of Proposition 3.1 

The goal of this section is to provide another proof of Proposition 3.1 and its odd 
orthogonal analogue by using divided differences operators. We start with the Lagrangian 
case. Let X„ = (xi,... ,Xn) be a sequence of indeterminates. Recall (see Section 5) 
that the symplectic Weyl group Wn is isomorphic to Sn x and the elements of Wn 
are identified with "barred permutations": if «; = (cr, r), a & Sn, r e then we 
write w as the sequence {wi, . . . ,Wn) endowed with bars on places where = — 1. In 
particular, wq = (1, 2, . . . , n) is the longest element of Wn- Consider in Wn the poset 
W^'^^ of minimal length left coset representatives of Wn modulo its subgroup generated 
by reflections corresponding to the simple roots Si — 82, ■ ■ ■ ,£n-i ~ (in the standard 
notation): 



V^^H ^ ^^{zi > Z2 > . . . > zi;yi < . . . < yn-i) e Wn, 1 = 0,1,... , n}. 
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The assignment w — {zi, . . . , zi;yi, . . . , y-n-i) ^ I = {zi, . . . , zi) establishes a bijection 
between the poset W^'^^ and the poset of all strict partitions contained in p^. 

One has divided differences : — > Z[X„] (w e Wn) i.e. operators of degree 
—l{w), whose definition has been explained in Section 5. 

Fix now an integer < A; < n and denote: 

tyC^) — (n,n- 1,... ,F+I;1,2, ... ,k). 

Observe first that for a strict partition I C Pn oi length /(/), d^(k)Qi{Xn) ^ only 
if n — k. (This is because d^(k) decreases the degree by l{w^''^) = n + (n — 1) + 

. . . + {k+ 1).) More precisely, writing = {—xi, . . . , —Xn), we have: 

Proposition 8.1. For a strict partition I of length n — k, d^(k)Qi{X^) iff 
I D {n,n — 1, . . . ,k + 1). In the latter case, writing I = {n,n — 1, . . . ,k + 1, ji, . . . , ji), 
where ji > and I ^ k, one has in Z[Xn], 

d^(k)Qi{X^) = Qn,...,ji{X^). 

Proof. Let / be a strict partition of length h ^ n — k. Let 

wi = (o^i, . . . , CT/i; ah+i, . . . , CTn) 
be the element of W^'^'^ corresponding to /. Then taking into account that 

(w^''))"^ = {n-k+l,n-k + 2,... ,n;n - k,n - k - 1, . . . ,T), 
we get wi o = 

(^n-fc + l > 'o'n-k + 2 > ■ ■ ■ > O'h, CT h + 1 < O'h + 2 < ■ ■ ■ < O"^, CT^-fe < CT^-fc-l < • • • < CTl). 

We have l{wi) = ai + ... + ah, /(w^'')) = n + (n - 1) + . . . + (A; + 1), and 

n—h 

l(wi o {w^''^)~^) = o-n-k+1 + o-n-k+2 + ■ ■ ■ + CTh + ^ card{l ^p^n-k\ap< ah+j} 

n—h 

by Lemma 5.1. Thus, denoting the above sum (...) by we get: 

l{wi) - /(w^'^)) - l{wi o (m;^'^))-!) = 

= CTl + . . . + a^-k - (n + (n - 1) + . . . + (A; + 1)) - 
Now, a necessary condition for dyj(k)Qi{X^) ^ is: 

CTl + ... + Gn-k - (n + (n - 1) + . . . + (/c + 1)) - ^ = 0, 
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which imphes (ui, . . . , (7n-k) — (n, n — 1, . . . , A; + 1) and ^ = 0, i.e., a"„ < an-k- 
(Using the theory from [B-G-G], [Dl,2] and the result from [P2] recalled in Theorem 2.1, 
the just proved assertion easily implies that d^(k)Qi{X^) = Qji,... (modi)). We 

will now prove directly that for / = (n,n — 1,... ,k+l, ji, . . . , ji) one has d^(k)Qi{X^) = 
Qji,... ,ji{X^) already in Observe that 

d^(k) = (dk... dido)... {dn-2- -dido) (dn-i... dido). 

The proof is by induction on n — A; — 1. For n — k — 1 = 0, one has (J = {ji, ...,ji)): 

dn-l...dido{Qn,j{X:i)) =drr-l...dido{eUX:i)-Qj{X:i)) 

= dn-i...di{{-X2)...{-Xn)Qj{X^) - en{X^) ■ doQj{X^)) 
= Qj{Xl) - e„ • dn-i...dido{Qj{Xl)) = QAX^), 

where the vanishing of the second summand in the latter difference follows from the just 
proved first assertion. 

The induction step goes as follows. By the equality proved above, 

{dk...dido)...{dn-2--dido){dn-i-dido){Qn,n-i,...,k+i,j{X^)) 

{dk...dido)...{dn-2-dido){Qn-l,n-2,...,k+l,j{Xn)) 

{dk...dido)...{dn-2...dido){Y.{-XnfY.Q^^^n-l)) 

i>0 

where the sum is over all partitions /C {n — l,n — 2,...,k + l,J) such that the diagram 
(n — 1, n — 2, k+ 1, J) /I is of weight i and has at most one box in every row (use 
the linearity formula, i.e. Proposition 4.1). Each time we get two equal parts p in a 
partition / such that Qi{X^_i) appears in the expression, we factor out Qp,p{X^_i) by 
Proposition 4.3. The last sum can be rewritten in the form: 

J2(-''-yQM{x:i_i)fM + Y.^-XnyQN{Xl-i)gN, 

i>Q M i>0 N 

where M (resp. N) runs over the so-obtained partitions contained in the partition 
(n — 1, n — 2, /c-|- 1, J) where some box is removed from the first n — k — 1 places (resp. 
no box is subtracted from the first n — /c — 1 places), and /m (resp. g^) denotes the 
corresponding monomial in the elements (5p,p(X^_i) obtained by factoring out. By the 
first assertion (applied to ^^_i) we know that our operator anihilates the first sum. By 
the induction assumption we get (with N = (n — l,n — 2,...,A;+1,J') and gji = Qn) 

{dk...dido)...{dn-2...dido){YY.^-^r^yQN{X:^-l)gN) 

i>0 N 

= T.T.(-'^-)'QAX:_,)gj, = Qj{X^^) 

i>0 J' 
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by the factorization property and the hnearity formula, now used backwards. □ 

We now pass to a geometric interpretation of the proposition. The setup and the 
notation is the same as in the proof of Proposition 3.1: V ^ B - rank 2n vector bun- 
dle endowed with a nondegenerate symplectic form, X — LG^V, denotes here the 
tautological subbundle on X and p : ^ X is the composition (see Section 1): 

LGn-k{C^/C) ^ GkiVn) ^ X, 

where C is the tautological rank k bundle on Gk{Vn)- The tautological rank n — k 
subbundle S for LGn-k{C'^ /C) is identified with D jCj: where D is rank n tautological 
subbundle on T . Let ri, r„ be the Chern roots of and di, - the Chern roots 
of D. Since Cjf C (Vn).F ^■nd Cjr c -D, we can assume that r\ = di, ...,rfc = dfc are the 
Chern roots of C. 

Claim : For any symmetric polynomial f in n variables, 

(tTi)* dn, di, 4)) = (a^/)(rfc+i, Tn, ri, Tfc), 



where v = (n — k,n — k — 1, 1, n — A; + 1, n). 

Indeed, for the Chern roots dk+i, ...idn of S one has by Proposition 5.8, 

(tti)* (/(dfe+i, ...,dn,di, ...,dk)) = (tti)* {f{dk+i, ...,dn,ri, ...,rk)) 

= {dyf){dk+i, ri, ...,rfc). 

We know by Proposition 5.9 that dyf is a polynomial symmetric in the squares of the 
first n — k variables. By Lemma 1.1 we have 

[S] + [S^] = [(C^/C)^] = [V:p] - [C^] - [C^] 

= [(Vn)T] + [(VM - [C:p] - [C^] = [(K)WC^] + mn)T/Crn 

Hence, for the Chern roots rfc+i, of Vn/C, 

{dvf){dk+i, dn, ri, rfc) = {dyf){rk+i, r^, r^) 

and the claim is established. 
We are now in position to give 

Another proof of Proposition 3.1. 

By virtue of the previous proposition it suffices to show that for every symetric poly- 
nomial f in n variables p*{f{di_, ...,dn)) — (9y,(fc)/) (ri, ...,rn)- For a polynomial g sym- 
metric in the first n — k - and in the last k variables, one has 



{9{rk+i, ■■■,rn,ri, ...,rk)) = {dug){ri, ...,rn), 
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where u = {k + 1, ...,n,l,2, k) (see [L2], [P2] and [Br]). (This can be proved using a 
reasoning similar to the one in the proof of Proposition 5.8 above.) Since w^'^^ = u o v 
and l{w^''^) = l{u) + l{v), we thus have, invoking the claim: 

{f{di, dn)) = p* (/(dfc+i, dn, di, dk)) = 7V2* (^nu. (/((ifc+i, dn, <ii, «ife))) 
= 7r2*((^i;/)(^fc+i, •••,rn,ri, ...,rfc)) = (9^,(a„/)) (ri, r^) 
= {{duO dy)f){r I,..., rn) = {d^w f){ri, ...,rn) 

which is the desired assertion. □ 

In the odd orthogonal case, by replacing Q-polynomials by P-polynomials and arguing 
in the same way as above, one proves the following proposition. 

Proposition 8.2. For a strict partition I of length ^ n — k, d^(k)Pi{X^) iff 
/ D (n, n — 1, . . . , A; + 1). In the latter case, writing I — (n, n — 1, . . . , k + 1, ji, . . . ,ji), 
where ji > and I ^ k, one has in Z[Xn], 

Let V ^ B he a, rank 2n + 1 vector bundle endowed with a nondegenerate orthog- 
onal form, X = OGnV and Vn denote the tautological subbundle on X. Then, by an 
appropriate interpretation of the Gysin map associated with the composition: 

OGr^-k{C^/C) ^ GkiVn) ^ X, 

where C is the tautological rank k bundle on Gk{Vn), one gets another proof of Propo- 
sition 3.4. 

We refer the reader to [L-P-R] for another operator treatment of Q- and P-polynomials 
and their generalizations. 

9. Main results in the generic case 

Let y be a rank 2n vector bundle over a smooth pure-dimensional scheme X endowed 
with a nondegenerate symplectic form. Let E and F. : Fi G F2 G ... G F^ = F he 
Lagrangian subbundles of V with rank Fi = i and rank E — n. For a given sequence 
a. = (1 ^ ai < ... < a/j ^ n), we are interested in a locus 

D{a.) := I a; e X| dim{E n F^J^ ^ p, p = 1, /c}. 

Let G — LGnV and let R GVahe the tautological rank n subbundle on G. By a well 
known universality property of Grassmannians there exists a morphism s : X — > G such 
that E = s*R. Therefore (in the set-theoretic sense) we have: 



D{a.) = s-\n{a.;F.)), 
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where 

n{a.;F.)= \^geG\ dim{R f] Fa^) g ^ p, p=l,...,A;}. 

We take this equahty as the definition of a scheme structure on D{a.), i.e., D{a.) is 
defined in X by the inverse image ideal sheaf (see [Ha, p. 163]): s~^I{Q{a.; F.)) ■ Ox 
where X(fi(a.; F.) is the ideal sheaf defining Q in G. It follows from the main theorem 
of [DC-L] that Q{a.; F.) is a Cohen-Macaulay scheme. Hence, by [K-L, Lemma 9] we 
get [L>(a.)] = s*[0(a.;F.)] provided D{a.) is either empty or of pure codimension equal 
to the codimension of 0(a.; F.) in G. Therefore, having a formula for the fundamental 
class of Q{a.; F.) given by a polynomial P in c.{R) and 0.(^0^)0, p = 1, k, the formula 
for D{a.) becomes P(^c.{E),c.{Fap)p=i,...,k)- Moreover, by using the Chow groups for 
singular schemes and a technique from [F] one can prove the following refinement of the 
above. If X is a pure-dimensional Cohen-Macaulay scheme and D{a.) is either empty or 
of pure codimension equal to the codimension of 0(a.; F.) in G then the class of D{a.) 
in the Chow group of X equals P(^c.{E), c.{Fap)p=i,...,k)^[X]. This reasoning (with 
obvious modifications) also applies, word by word, to the case of rank 2n + 1 vector 
bundle endowed with a nondegenerate orthogonal form. 

In particular, for a. = (n — k + 1, n) we have by Proposition 3.2: 
Theorem 9.1. If X is a pure- dimensional Cohen-Macaulay scheme and the subscheme 

^ {xeX\ dim{E n F)^ ^ k} 

is either empty or of pure codimension k{k -\- l)/2 in X, then the class of (endowed 
with the above scheme structure) in the Chow group of X equals 

[D'] = (j2QiE''-Qp,^iF'')n[x], 

where the sum is over all strict partitions I <Z pk- 

Example 9.2. The expressions giving the classes for successive k are: 

k=l QiE^ + QiFV; 

k=2 Q21E'' + Q2E'^ ■ QiF^ -f QiE'' ■ Q2F'' + Qaii^""; 

k=3 + ■^QiF'' +QsiE'' ■^Q2F'' + Q21E'' ■ Q^F^ + Q^E'' ■ Q21F'' + 

Q2E'^ ■ Q^^F^ + Q^E^ ■ Qs2F'' + Q321F'' ■ 

For a. = (n -I- 1 — z) we get: 

Theorem 9.3. Let X be a pure- dimensional Cohen-Macaulay scheme and assume that 
the subscheme S'^ = {x & X\ dim{E fl Fn-\-i-i)x ^ 1} is either empty or of pure codi- 
mension i in X. Then 

i 

p=0 
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Example 9.4. The expressions giving the classes for successive i are: 
i=l ciE^ + siF"^; 
i=2 + ciE''siF^(_, + S2F^_^; 

i=3 C3E'' + C2£;^siF,^_2 + ciE''s2F^_^ + S3F^_2. 

The theorem is a globalization to degeneracy loci of Proposition 6.1. Also other 
formulas from Sections 6 and 7 admit analogous globalizations. We concentrate ourselves 
on a solution to J. Harris' problem for Mumford-type degeneracy loci mentioned in the 
Introduction. 

The odd orthogonal analog of Theorem 9.1 is a consequence of Proposition 3.4 and 

reads as follows: 

Theorem 9.5. Let X he a pure- dimensional Cohen- Macaulay scheme over a field of 
characteristic different from 2. Suppose that V is a rank 2n + 1 vector bundle endowed 
with a nondegenerate orthogonal form. Let E and F be two rank n isotropic subbundles 
ofV. If the subscheme 

D'' = {xe X\ dim{E n F)^ ^ k} 

is either empty or of pure codimension k{k-\-l)/2 in X , then the class of in the Chow 
group of X equals 

(J^PiE^'-Pp.-.iF^) n [X], 

where the sum is over all strict partitions I C pk-^ 

Let now F be a rank 2n vector bundle over a connected pure-dimensional scheme X 
endowed with a nondegenerate orthogonal form. Let E and F. : Fi G F2 G . . . G F^ — F 
be isotropic subbundles of V with rank Fi = i and rank E — n. One should be careful 
here with the definition of D{a.). For a given sequence a. = (1 ^ ai < . . . < ^ n), 
where k is such that dim{E fl F)^ = k{mod 2) if Ofc = n, we are interested in the locus 

D{a) = e X| dim{E n Fa^)^ ^ p , p = 1, . . . , 

There is a morphism s = (s', s") : X OG'^V U OG'^V such that s*R = E where 
R is the tautological rank n subbundle on OG'^V U OG'^V. We have (in the scheme - 
theoretic sense) that if /c = n {mod 2) then 

D{a.) = {s'r'^{a:,{F.)oG'^v); 
and if A; = n + l{mod 2) then 

Dia,) = is")-'^{a-AF.)oG'^v). 

The even orthogonal analog of Theorem 9.1 reads as follows: 

^Observe that though the P-polynomials of a vector bundle are defined only when the Chern classes 
of the vector bundle are divisible by 2, the integrality property of the classes obtained in the theorem 
holds true. One argues as in the preceding footnote, taking into account that the base change argument 
[K-L, Lemma 9] preserves the integrality too. The same remark applies to the even orthogonal case 
(Theorem 9.6 below). 
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Theorem 9.6. If X is a connected pure- dimensional Cohen- Macaulay scheme over a 
field of characteristic different from 2 and the subscheme 

D'' ^ {x e X\ dim{E n F)^ ^ k}, 

defined for k such that k = dim{E fl F)^ {mod 2) where x & X, is either empty or is of 
pure codimension k{k — l)/2 in X, then the class of in the Chow group of X equals 

{^PjE^ .P,,_,^jF^)n[X], 

where the sum is over all strict partitions I C pk-i- 

Example 9.7. The expressions giving the classes for successive k are: 
k=l 1; 

k=2 PiE^ + PiF^; 

k=3 P2iE'^ + ■ PiF^ + PiE^ ■ P2F^ + P2iF^; 

k=4 Ps2iE'' + Ps2E'' ■^PiF'' + P^iE"" ■P2F'' + hiE"^ ■ PsF"" + P3E'' ■ P21F'' + 

Remark 9.8. All the formulas stated in this section in the Chow groups have their direct 
analogs in topology. Perhaps the simplest version is the following. Assume that X is a 
compact complex manifold, the bundles E, F^ are holomorphic and the morphism s from 
X to LGnV above is transverse to the smooth locus of the Schubert variety Q{a.;F.). 
Then the cohomology fundamental classes of D{a.) are evaluated by the corresponding 
(given above) expressions in the Chern classes of E and F^. The same applies to the 
orthogonal case. 

Appendix A : Quaternionic Schubert calculus 

Let EI denote the (skew) field of quaternions. Let Pjj be the projective space that 
is identified with (]HI"'+-'^ \ {0})/ ~; where (/ii, . . . , hn+i) ~ (/I'l, ■ ■ ■ , /^n+i) there is 
^ h e M such that hi = h ■ h'^ for every i. It is a compact, oriented manifold over IR 
of dimension 4n. Let us recall after Hirzebruch [HI], that, in general, this real manifold 
does not admit a structure of a complex analytic manifold. 

Let Gfc(H"^) be the set of all A;— dimensional subspaces''' of H"". Gk(^^) has a natu- 
ral structure of 4A;(n — /c) -dimensional, compact, oriented manifold over M. Of course 

Let F/fc^ ... jtr(EI") be the set of all flags of subspaces of consecutive dimensions 
{ki, . . . , kr) over H. It is also a compact, oriented manifold over M. One has (see [B], 
[SI]), Flk„...,kM'') = Spin)/lll=QSp{h+i - ki) (here, /cq = and kr+i = n). Of 
course F/fc,(e") = G'fc,(H"). 

^ the word "(sub) space" means always a "left H- (sub) space". 



62 



10.1. ([B, 31.1 p. 202]) Let yi,-- - ,yn be a sequence of independent variables with 
deg yi = 4. Then 

H*(^Fh„...,kA^n,^)=Sr{yi,...,yn)/Ik„...,k., 

where Iki,...,kr ^■^ the ideal generated by polynomials symmetric in each of the sets 
{yki+i, • • • , yki+A> ^ = 0; 1> separately (ko = 0, K+i = n). 

For instance (all cohomology groups are taken with coefficients in Z), 

H^{Fl)^Z[y]/{y-+'), deg y = 4; 

H*(Gk{M^)) =SV{yi,... ,yn)/Ik, deg y^ = 4. 

We see that these cohomology rings are double-degree isomorphic with the cohomology 
rings of their complex analogues. 

Fix now a flag V. : l/i C V2 C . . . C 14, of subspaces of with dimuVi = i. For 
every partition / C (n — A;)'^ we set 

a{I) = |l e Gk{M^) I dimm{L n Vn-k+p-iJ = p , p = 1, . . . , /c}. 

The so deflned (/ C (n - k)'') give a cellular decomposition of ^^(H") and the 
codimension of a(I) is 4|/|. Now define 

a{I) = a{I,V.)={LeGkm \ dimmiL nVn-k+p-i,) > p , p = 1, . . . ^kj. 

The cohomology classes of (t(/, K), in fact, do not depend on the flag V. chosen and will 
be denoted by the same symbol cr(/). We record: 

10.2. (Pieri-type formula) InH*{Gk{W^) one has 

a{L).a{r) = Y,a{J\ 

where the sum is over J such that ip ^ jp ^ ip-i and \J\ = \L\ + r. 

Not all proofs of the Fieri formula for Complex Grassmannians can be extended to 
the quaternionic case. However, the proof in [G-H, pp. 198-204] has this advantage. As 

a matter of fact, Gk{^^) is an oriented compact manifold and thus its cohomology ring 
is endowed with the Poincare duality. Moreover, one checks by direct examination that 

cr(/) • a(n — k — ik, ■ ■ ■ , n — k — iij = cr((n — k)^) = [pt]. 

Then the proof in loc.cit. goes through mutatis mutandis also in the quaternionic case. 

We can restate this information about the multiplicative structure in iy*(Gfc(E[")) as 
follows: 
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10.3. Let Y = {yi, . . . ,yk) be independent variables of degree 4- The assignment 
s/(j/i, . . . ,yk) I— > cr(/) for I C (n — k)'', and -otherwise, is a ring homomorphism, and 

allows one to identify H* [GkiJ^)) with a quotient of SViY) modulo the ideal ®'LsiiY), 
the sum over I (/l {n — k)^ . 

This result has a number of useful consequences. For example, it implies immediately 
that the signature of the Complex Grassmannian (see [H, p. 163] and [H-S, Formula 
(23) p. 336] is the same as the one of the Quaternionic Grassmannian - a result proved 
originally in [SI] using different methods. 

We now describe a certain fibration which makes the Quaternionic Grassmannians 
useful in study of the Grassmannians of non-maximal Lagrangian subspaces (which are 
not Hermitian symmetric spaces). 

Let V — C^"^ be endowed with a nondegenerate symplectic form $ given by the matrix 



A = 



-In 



where /„ is the (n x n) -identity matrix. 

Having in mind the standard notation associated with EI we endow V with a structure 
of H-space setting yv — Av, where " ~ " denotes the complex conjugation (note that 
A^ = -idv). 

10.4. If U <ZV is k— dimensional Lagrangian C-subspace ofV then dimmi^ ■ U) = k. 
Moreover, the restriction of the symplectic form $ to any M-subspace of V, is nondegen- 
erate. 

To show this consider the standard Hermitian scalar product <, > on V = C^"'. 
Now given U, we take a C— basis ui, . . . ,Uk such that < Up, Uq >= 5p^q. We claim that 
Ml, . . . , Wfc, jiii, . . . , j^ifc are linearly independent over C (which implies dim^{M.-U) = k). 
This claim follows immediately from ^{up,Uq) = = $(jup,juq) and $(up,juq) = 

ulA{AUq) = - < Up,Uq >= Sp^q. 

Suppose now a H— subspace W C V is given with dimuW = k, say. We can always 
find C— linearly independent vectors tui , . . . , tu/- e W such that ^{wp.,Wq) = and 
< Wp.Wq >= Sp^q. Then jwi, . . . also belong to W. It follows from ^{wp,Wq) = 
= ^(jwpjjwq) and ^{wp^jwq) = —8p,q that wi, . . . , Wfe,jiui, . . . ,jwk form a C— basis 
of W and the form $ restricted to W is nondegenerate. 

We infer from the above 

10.5. The assignment U i-^Il-U, defines a locally trivial fibration of LGk(C^^) over 
Gk (H") with the fiber LGk {C^'') • 

In other words, denoting by S the tautological (sub)bundle over Gj^ (H") , rank^S = k, 

we have an identification LGkiC^"") = LGkiS), where the latter symbol denotes (the 
total space of) the corresponding Grassmannian bundle. 
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This identification can be used in reduction of some problems about Grassmanni- 
ans of non-maximal Lagrangian subspaces to the problems about the Grassmannians of 
maximal ones. For example, we get from 10.5 the following identity of Poincare series: 

thus reproving the result from [P-R2, Corollary 1.7]. 

Similar fibrations exist for flag varieties. Let LF/jt^,... .fc,, (C^"^) be the variety paramet- 
rizing Lagrangian ( w.r.t. $ ) flags of dimensions (ki, . . . , kr) in C^"^. 

10.6. The assignment (dimcUi = ki, i = 1, . . . ,r): 

(Ui CU2 C ... cUr^ ^ (m-Ui cm-U2 C ... CM-Ur') 

is a locally trivial fibration of LFlk,,... .kA'^^'') over Flk,,... ^kA^"") ■ If C^^^ C C^''" C 
. . . C C^'^'' is a (part of) the standard flag, then the fiber of this fibration is the vari- 
ety parametrizing Lagrangian flags Wi C W2 C . . . C Wr such that Wi C C^'^* and 
dimcWi = ki, i = 1,.. . ,r. 

Therefore the fiber is a composition of Lagrangian Grassmannian bundles of maximal 
subspaces. In particular, we obtain the following formula for the Poincare series of 

r 

-f'ii^«fci,...,fc,(C2")(*) = -PFife^,...,fc^(II")(*) • II-^LGfe._fc._,(C2('=i-'=i-i))(*)' 



where ko = 0. Since explicit expressions for the factors on the right-hand side are known 
(see (10.1)), this gives an explicit formula for PlfIu^ fe^(C2")(^)- 

10.7. Finally, we show an algebro-topological interpretation (as well as another proof) 
of the identity: 

Si{x\, . . . ,a;^) • Sp^{xi, . . . ,Xn) = S2l+p^{xi, . . . ,Xn) 

from Section 5. To this end we show two different ways of constructing LFl := LFZ(C^"). 

The first way is given by taking the total space of the flag bundle Fl{R) — > LG„(C^"^) 

where R is the tautological vector bundle on LG„(C^"). The second way relies on the 
following observation: LFl can be interpreted as the variety of flags Wi C W2 C . . . C 
W2n such that dimcWj = j and each W2j is a H-subspace. This realization is given by 
the assignment: 

C C. . . C k) ^ (Vi C H • C H • Vi + C H • Vi + H • C. . . ) 



65 

Equivalently, using the tautological sequence C <S'2 C . . . C Sn, rank^Si — i, on Fl-^, 
this corresponds to taking the total space of the product of projective bundles 

P := P(52/5i) Xfi^ . . . XfI^ F{Sn/Sn-l) ^ Flu 

where Si^i/Si, i = 1, . . . ,n, are considered as rank 2 complex bundles. 

The same holds in the relative situation, i.e. given a rank 2n vector bundle F — > X 
endowed with a symplectic form we get a commutative diagram 

P = LFl{V) = Fl{R) 



ri 



T2 -v 



Fln{V) X LGnV 

where Fl^iV) is the Quaternionic (complete) flag bundle. Let xi, . . . , x„ be the sequence 
of the Chern roots of the tautological quotient bundle on LGnV . By Corollary 5.6(i) we 
know that if there exists an even ip, then (772 o tti)* (x^^ • . . . • a;^") = 0. (Calculating the 
other way arround, this follows easily from the projection formula.) On the other hand, 
iff all ip are odd, then (see Proposition 5.5) 

Sp^xi,... ,x„) ■ (7r2 o7ri)*(xii ■ . . . ■ x';^) = s/_p„_, (xi, . . . ,x„). 

Putting ip = 2jp + 1 and calculating the other way around, we get 

Indeed, recalling the notation from 10.1 we have Up = x^, p = 1, . . . , n (see [B, 31.1]), 
and we use the fact that (r2)* is induced by the Jacobi symmetrizer (recalled in the 
proof of Corollary 5.6(ii) and that of Lemma 5.7(ii) ) this time applied to yi, ■ ■ ■ ,yn- 
The latter statement follows from 10.1 by exactly the same reasoning as that used in the 
proof of Lemma 2.4 in [PI]. Comparison of the results of both computations, yields the 
desired identity. 



Appendix B : Introduction to Schubert polynomials a la polonaise 

We provide here a brief sketch of a theory of symplectic Schubert polynomials which 
has grown up from the present work. For details and further developments as well as for 
the orthogonal Schubert polynomials, we refer the reader to [L-P-R]. 

Let (xi, a;2, . . . ) be a sequence of independent variables. Let wq be the longest element 
in the Weyl group Wn of type Cn ■ Define 

(^wo •~ ^wo {xij ■ ■ ■ J Xn) '■— ( 1) ^ ''^ X^ X2 ■ ■ ■ ^n— 1 "^n Q Pn (•^1) • • • ) Xn) , 
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and for an arbitrary w e , 

Above, by d'^ {w e Wn) we understand the composition of the divided difference opera- 
tors dl defined by 

5o(/) = (/" W)/2xi 

d'iif) = (/ - Sif)/{xi+i -Xi) i = 1, 2, . . . , n - 1 , 

associated in a usual way with an arbitrary reduced decomposition of w using Si , i = 
0,1,... ,n-l. 

These polynomials satisfy the following properties. 

1. (Stability) Suppose that m > n. Let Wn ^ Wm be the embedding via the first n 
components. Then, for any w e Wn, the following equality holds: 

{xi, . . . , Xn%) \ xn+i = ---=Xm=0 ~ {xi, . . . , a^n) • 

2. (the Grassmannian case) Let / = (zi > . . . > Zfc > 0) be a strict partition contained 
in pn ■ Set 

wi = {ii,... , ik,jl <32< ■■■< jn-k) , 
where {ii,... - Jn-k} = {1, 2, . . . , n} . Then 

Cyjj (a^i , . . . , iCjj) — Q ji^xij . . . J Xn) ■ 



As we know from Section 4, Qi{xi, . . . ,Xn) is a positive sum of monomials. The 
polynomial has not this property. Also, it is in general neither negative nor positive 
sum of monomials. 

The following is the list of symplectic Schubert polynomials for n = 2. 

C^Y,2) ~ ~ X1X2 — X1X2 
^(1,2) ~ —X1X2 1 ^(2,1) ~ ^1^2 + X1X2 

^(2,1) ~ X1X2 , ^(2,T) ~ ^2 

C{2,1) = X2 , C^X^2) =Xi+X2 

C(i,2) = 1 • 



67 



References 

[A-C] E. Akyildiz, J.B. Carrell, An algebraic formula for the Gysin homomorphism from G/B to 
G/P, Illinois J. Math. 31 (1987), 312-320. 

[A] E. Artin, Geometric Algebra, Interscience, New York, 1957. 

[B-G-G] I.M. Bernstein, I.M. Gel'fand, S.I. Gel'fand, Schubert cells and cohomology of the spaces G/P, 

Russian Math. Surveys 28 (1973), 1-26. 
[B-F] A. Bertram, B. Feinberg, On stable rank 2 bundles with canonical determinant and many 

sections, preprint, University of Utah, Salt Lake City, (1992). 
[B-H] S. Billey, M. Haiman, Schubert polynomials for the classical groups. Journal of the Amer. Math. 

Soc. 8 (1995), 443-482. 

[B] A. Borel, Sur la cohomologie des espaces fibres principaux et des espaces homogenes de groupes 
de Lie compacts, Ann. of Math. 57 (1953), 115-207. 

[Bou] N. Bourbaki, Algebra, Ch.IX, Herrmann, Paris. 

[Br] M. Brion, The push-forward and Todd class of flag bundles, in "Parameter Spaces", Banach 

Center Publications 36 (1996). 
[B-E] D. Buchsbaum, D. Eisenbud, Algebra structures for finite free resolutions, Amer. J. Math. 99 

(1977), 447-485. 

[DC-L] C. De Concini, V. Lakshmibai, Arithmetic Cohen- Macaulayness and arithmetic normality for 

Schubert varieties, Amer. J. Math. 103 (1981), 835-850. 
[DC-P] C. De Concini, P. Pragacz, On the class of Brill-Noether loci for Prym varieties. Math. Ann. 

302 (1995), 687-697. 

[Dl] M. Demazure, Invariants symetriques entiers des groupes de Weyl et torsion, Inv. Math. 21 

(1973) , 287-301. 

[D2] M. Demazure, Desingularisation des varietes de Schubert generalisees, Ann. Scient. Ec. Norm. 
Sup. 7 (1974), 53-88. 

[D-L-T] J. Desarmenien, B. Leclerc, J.-Y. Thibon, Hall-Littlewood functions and Kostka-Foulkes poly- 
nomials in representation theory, Preprint - Institut Gaspard Monge 94-13 (1994). 

[E-G] D. Edidin, W. Graham, Characteristic classes and quadric bundles, Duke Math. J. 78 (1995), 
277-299. 

[E-vG] T. Ekedahl, G. van der Geer, work in progress. 
[F] W. Fulton, Intersection Theory, Springer, 1984. 

[Fl] W. Pulton, Schubert varieties in flag bundles for the classical groups, preprint, University of 
Chicago, (1994); to appear in Proceedings of the Conference in Honor of Hirzebruch's 65th 
Birthday, Bar Ilan, 1993. 

[F2] W. F\ilton, Determinantal Formulas for Orthogonal and Symplectic Degeneracy Loci, preprint, 

University of Chicago, (1994); to appear in J. Diff. Geometry. 
[G-H] P. Griffiths, J. Harris, Principles of Algebraic Geometry, Wiley-Interscience, 1978. 
[Har] J. Harris, Theta- characteristic on algebraic curves. Trans, of the Amer. Math. Soc. 281 (1982), 

611-638. 

[Ha] R. Hartshorne, Algebraic Geometry, Graduate Texts in Math., Springer, 1977. 

[H-B] H. Hiller, B. Boe, Pieri formula for S02n+i /Un and Spn/Un, Adv. in Math. 62 (1986), 49-67. 

[HI] F. Hirzebruch, Uber die quaternionalen projektiven Raiime, Sitzungsber. Bayer. Akad. Wiss. 

Math. - Naturwiss. Kl. 27 (1953), 301-312; also "Collected Papers" vol. I, Springer, 1987, 

81-92. 

[H] F. Hirzebruch, Topological Methods in Algebraic Geometry (3rd edition). Springer, 1966; also 

"Collected Papers" vol. I, Springer, 1987, 151-334. 
[H-S] F. Hirzebruch, P. Slodowy, Elliptic genera, involutions and homogeneous Spin manifolds, 

Geom. Dedicata 35 (1990), 309-343. 
[K-L] G. Kempf, D. Laksov, The determinantal formula of Schubert Calculus, Acta Math. 132 

(1974) , 153-162. 

[K-K-L] A. Kerber, A. Kohnert, A. Lascoux, SYMMETRICA, an object oriented computer algebra 
system for the symmetric group, J. Symbolic Comp. 14 (1992), 195-203. 



68 



[L-Se] V. Lakshmibai, C.S. Seshadri, Geometry of G/P II, Proc. Indian Acad. Sci. A 87 (1978), 1-54. 
[LI] A. Lascoux, Puissances exteurieurs, determinants et cycles de Schubert, Bull. Soc. Math. 

France 102 (1974), 161-179. 
[L2] A. Lascoux, Interpolation de Lagrange, in: Second International Symposium (Segovia 1986): 

"On Orthogonal Polynomials and their Applications", Monograf. Acad. Ci. Exact. Fis.-Quim. 

Nat. Zaragoza 1 (1988), 95-101. 
[L-L-T] A. Lascoux, B. Leclerc, J.-Y. Thibon, Fonctions de Hall-Littlewood et polynomes de Kostka- 

Foulkes aux racines de I'unite, C. R. Acad. Sci. Paris t. 316 (1993), 1—6. 
[L-P-R] A. Lascoux, P. Pragacz, J. Ratajski, Symplectic and orthogonal Schubert polynomials a la 

polonaise, in preparation. 

[L-Sl] A. Lascoux, M.P. Schiitzenberger, Formulaire raisonne des fonctions symetriques, Prepubli- 

cation L.I.T.P., Universite Paris 7, 1985. 
[L-S2] A. Lascoux, M.P. Schiitzenberger, Symmetry and flag manifolds, in "Invariant Theory" (F. 

Gherardelli-ed.), Springer Lectures Notes in Math. 966 (1983), 118-144. 
[Mcdl] I.G. Macdonald, Symmetric functions and Hall polynomials, Oxford Univ. Press, 1979. 
[Mcd2] I.G. Macdonald, Notes on SchubeH polynomials, Publ. LACIM 6, UQUAM, Montreal, 1991. 
[Mo] A.O. Morris, A note on the multiplication of Hall-Littlewood polynomials. Journal London 

Math. Soc. 39 (1964), 481-488. 
[Mu] S. Mukai, Vector bundles and the Brill-Noether theory, preprint, Nagoya University (1994). 
[M] D. Mumford, Theta characteristics of an algebraic curve, Ann. Scient. Ec. Norm. Sup. 4 (1971), 

181-192. 

[O] F. Oort, Subvarieties of moduli spaces, "1. Mathematische Arbeitstagung (Neue Serie)", Max- 

Planck Institut ffir Mathematik Preprint 93-57 (1993). 

[PI] P. Pragacz, Enumerative geometry of degeneracy loci, Ann. Scient. Ec. Norm. Sup. 21 (1988), 
413-454. 

[P2] P. Pragacz, Algebro- geometric applications of Schur S- and Q -polynomials, Seminare d'Alge- 
bre Dubreil-Malliavin 1989-1990 (M.-P. Malliavin - ed.). Springer Lecture Notes in Math. 1478 

(1991), 130-191. 

[P3] P. Pragacz, Symmetric polynomials and divided differences in formulas of intersection theory, 
in "Parameter Spaces", Banach Center Publications 36 (1996). 

[P-RO] P. Pragacz, J. Ratajski, Formulas for some symplectic and orthogonal degeneracy loci, manu- 
script. Math. Inst. Polish Acad. Sci., Toruh, August 1993. 

[P-Rl] P. Pragacz, J. Ratajski, Fieri type formula for isotropic Grassmannians; the operator approach, 
Manuscripta Math. 79 (1993), 127-151. 

[P-R2] P. Pragacz, J. Ratajski, A Fieri type theorem for Lagrangian and odd orthogonal Grassmanni- 
ans, Max-Planck Institut fur Mathematik Preprint 94-15 (1994); to appear in J. reine angew. 
Math.. 

[S] I. Schur, Uber die Darstellung der symmetrischen und der alternierenden Gruppe durch ge- 

brochene lineare Substitutionen, J. reine angew. Math. 139 (1911), 155-250. 

[SI] P. Slodowy, On the signature of homogeneous spaces, Geom. Dedicata 43 (1992), 109—120. 

[W] G. Welters, A theorem of Gieseker- Fieri type for Frym varieties, Ann. Scient. Ec. Norm. Sup. 
18 (1985), 671-683. 



